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EXECUTIVE  SU^MMIY: 


FY  1983-1984  FINAL  REPORT 
to  the 

NATIONAL  AERONAUTICS  AND  SPACE  AEMINI STRATION 

on 

NASA  CONTRACT  NUMBER  NASW-3846 
"NASA  REOON: 

COURSE  DEVELOPMENT,  AIMIN I STRATION,  AND  EVALUATION” 


In  December,  1983,  the  National  Aeronautics  and  Space 
Administration  (NASA)  entered  into  a contractual  agreement  (NASA 
Contract  Number  NASW-3846)  with  the  University  of  Southwestern 
Louisiana  (USL)  and  Southern  University  (SU)  for  contracted 
research  and  development  activities  addressing  the  development, 
administration,  and  evaluation  of  a set  of  transportable, 
CO  1 1 ege- 1 e ve 1 courses  to  educate  science  and  engineering  students 
in  the  effective  use  of  automated  scientific  and  technical 
information  storage  and  retrieval  systems,  and,  in  particular,  in 
the  use  of  the  NASA  REOON  system. 


This  Executive  Sunmary  of  the  FY  1983-1984  Final  Report  on 
NASA  Contract  Number  NASW-3846  will  briefly  overview  the 
long-range  scope  and  objectives  of  these  contracted  activities 
and  will  highlight  the  progress  which  has  been  made  toward  these 
objectives  during  FY  1983-1984. 
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LONG-RANGE  SCX)PE  AND  OBJECTIVES 


In  order  to  provide  an  overview  of  the  long-range  scope  and 
objectives  of  the  contracted  activities,  this  section  will 
highlight  the  major  thrusts  of  these  activities.  In  the  interest 
of  brevity,  focus  will  be  placed  on  identifying  primary 
objectives,  rather  than  on  presenting  all  supportive  details. 
These  objectives  are  as  follows: 


(1)  The  development  of  an  educational  program  comprising  a set 
of  courses  with  varying  degrees  of  emphasis  on  the 
principles  and  concepts  of  interactive  information  storage 
and  retrieval  systems  and  the  specifics  of  effectively 
utilizing  specific  selected  systems.  The  course  set 
i nc 1 ude  s : 


(a)  18  week  full  semester  course 

(b)  12  week  full  quarter  course 

(c)  6 week  mini-course 

(d)  1-2  day  intensive  workshops. 


(2) 


The  development  of  an  educational  program  incorporating 
extensive  hands-on  interactive  usage  of  multiple  large-scale 
interactive  information  storage  and  retrieval  systems  and 
multiple  data  bases: 


(a)  Initial  NASA-funded  work  is  to  develop  specific  course 
modules  addressing  NASA  RECX)N. 

(b)  Plans  include  establishing  contractual  agreements  with 
other  agenc i e s / sy s t em  vendors  to  incorporate  course 
modules  tailored  to  additional  systems  (and  their 
supported  data  bases),  such  as  DIALOG,  DOE/RECX)N,  SDC, 
BRS,  DoD/DTIC/DROLS,  etc. 

(3)  The  development  of  an  educational  program  targeted  at 
scientific  and  engineering  disciplines;  assumptions  include 
non-computer-professional,  non-IS&R-profess ional  instructors 
(science  and  engineering  faculty)  and 

non-computer-professional,  non-IS&R-profess ional  audience 
(senior  undergraduate  science  and  engineering  students). 


(4)  The  development  of  fully  transportable  educational  programs 
and  course  materials  to  facilitate  wide  distribution  of  the 
educational  programs  to  colleges  and  universities  throughout 
the  United  States: 


(a) 


Course  material  development  philosophy  is  predicated  on 
a set  of  system-independent,  discipline-independent 
core  materials,  with  hooks  for  incorporating 
system-specific  modules  and  discipline-specific 
examples  throughout. 
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(b)  Candidate  entries  within  course  materials  packages 
include : 

Cour  s e syllabi 

Lesson  plans 

Overhead  transparencies 

Homework  assignments  with  answer  keys 

Hands-on  usage  assignments  with  answer  keys 

Examinations  with  answer  keys 

Discussion  topics 

Instructor  guides 

Workbooks 

Textbooks 

Bibliographies 

Additional  support  handouts 

Videotapes  and/or  films. 

(5)  Overall  planning  and  management  of  phased  activities: 

(a)  Needs  analysis 

(b)  Course  development 

(c)  Pilot  course  administration 

(d)  Pilot  evaluation 

(e)  Development  of  ’’marke  t ing  ”/d  i s t r i but  i on  plan 

(f)  Implementation  of  "market ing”/di stribut ion  plan 

(g)  Conduct  of  regional  seminars 

(h)  Conduct  of  on-site  seminars 

(i)  Coordination  of  request  processing  / information 
di  s s emi  nation 

(j)  Course  state-of-the-art  enhancements 

(k)  Additional  system-oriented  and  data  base-oriented 
enhancements 

(l)  Institutional  surveys/evaluations 

(m)  Graduated  student  surveys/evaluations 

(n)  Periodic  statistical  sunxnary  reporting 

(6)  The  utilization  of  educational  evaluation  results  to  define 
required  K&D  support  areas  and  correspondingly  the 
translation  of  B&D  results  into  educational  applications  and 
enhancements  to  the  educational  programs. 

As  should  be  evident  from  the  brief  overview  presented 
above,  this  is  a very  well  conceived  program  which  should  offer 
considerable  benefits  to  participating  agencies. 
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OVERVIEW  OF  FY  1983-1984  PROGRESS  AND  ACOCMPLISHvlENTS 


This  section  will  provide  a brief  executive  overview  of  the 
progress  which  has  been  made  and  the  accomplishments  which  have 
been  achieved  during  the  FY  1983-1984  efforts  on  this  contract. 

Throughout  this  section,  all  claims  made  concerning  items  of 
progress  and  accomplishments  will  cross-reference  the  specific 
documents  and  deliverables  that  have  been  produced  during  FY 
1983-1984  which  substantiate  the  claims.  A table  of  contents  of 
these  documents  and  deliverables  is  provided  as  an  attachment 
entitled  ”FY  1983-1984  Final  Report  Table  of  Contents  of 
Documentation/Deliverables  Completed  to  Date”.  The  full  text  of 
each  of  these  39  major  deliverables  can  be  found  in  the  Final 
Report . 

The  remainder  of  this  Executive  Sunxnary  will  highlight 
progress  made  during  FY  1983-1984  in  the  following  major  areas: 


I.  Overall  Project  Management  and  Control 

II.  Needs  Analysis  Phase 

III.  Course  Development  Phase 

IV.  Working  Paper  Series  Information  Dissemination 

V.  PC  R&D  Supportive  Research  and  PC  R&D  Working  Paper  Series 

VI.  Other  Research  Support  Activities 


These  six  major  categories  correspond  to  the  major 
categorization  of  docmnent at i on/de  1 iverab 1 e s completed  to  date  as 
illustrated  in  the  attachment  to  this  Executive  Sumnary. 


I.  Overall  Project  Management  and  Control 


In  light  of  the  long-range,  multi-year  orientation  of  these 
contracted  efforts,  serious  attention  has  been  devoted  to  the 
long-range  strategic  planning  and  short-range  tactical  planning 
of  all  tasks  and  activities  in  order  to  ensure  the  establishment 
of  an  overall  project  management  and  control  philosophy  and 
supportive  progress  tracking  and  reporting  mechanisms. 


This  philosophy  is  predicated  on  the  necessity  of  adopting  a 
formal  methodology  for  addressing  task  initiation,  definition, 
scheduling,  milestone  specification,  resource  allocation, 
progress  status  monitoring,  and  final  documentation.  Such  a 
philosophy  and  resulting  methodology  was  adopted  at  the  very 
inception  of  the  contract  efforts  and  has  been  maintained  through 
all  subsequent  contract  activities,  resulting  in  the  conduct  of  a 
well  planned  and  highly  controlled  research  and  development 
environment  in  support  of  all  contract  efforts. 

Examples  of  the  automated  project  management  and  control 
reports  that  suninar ize  the  results  of  these  processes  can  be 
found  in  items  1.1  and  1.2  of  the  attachment. 


II.  Needs  Analysis  Phase 


During  FY  1983-1984,  a transportable  information  storage  and 
retrieval  system  courses  needs  analysis  questionnaire  was 
developed  and  distributed  to  237  colleges  and  universities 
throughout  the  United  States.  The  questionnaire  was  completed  and 
returned  by  161  respondents  (typically  at  the  level  of  Academic 
Vice-Presidents,  Deans  of  Colleges  of  Physical  Sciences,  and 
Deans  of  Colleges  of  Engineering). 

A very  brief  overview  of  some  of  the  major  results  of  the 
questionnaire  follows: 

(1)  Computer  usage  is  viewed  as  a very  important  or  important 
educational  objective  in  Engineering  by  86.8%  of  the 
respondents  and  in  Physical  Sciences  by  68.2%  of  the 
respondent  s . 

[Results  are  highly  complementary  to  our  educational 
objectives.] 

(2)  Availability  of  local  computing  access  facilities  is 
substantial,  for  example,  responses  indicate  that 
substantial  departmental  computer  terminals  exist  (86.7%  in 
Engineering,  79.7%  in  Physical  Sciences)  and  even 
substantial  departmental  personal  computers  exist  (66.7%  in 
Engineering,  59.3%  in  Physical  Sciences). 

[Results  indicate  that  availability  of  local  computer  access 
facilities  will  not  be  a problem  in  the  local  implementation 
of  our  online,  hands-on  oriented  educational  programs.] 

(3)  A substantial  number  of  colleges  and  universities  do  already 

have  access  to  one  or  more  IS&R  systems  (72.0%);  that  these 
systems  are  typically  available  to  all  Engineering 

departments  (68.2%)  and/or  to  all  Physical  Science 
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departments  (76.6%).  However,  while  these  systems  are 
typically  available  to  all  faculty  (98.3%),  to  all  staff 
(90.4?o),  to  all  students  for  coursework  (68.7%),  and  to  all 
students  for  research  (87.0%),  they  are  typically  being  used 
almost  exclusively  by  librarians  (94.8%)  and  in  only  8 . 69i>  of 
the  colleges  and  universities  responding  were  students 
reported  as  conducting  searches  themselves! 

[These  results  provide  very  strong  justification  for  the 
need  for  our  educational  programs  targeted  at  hands-on  use 
of  IS&R  systems  by  the  end-users  themselves,  e.g.,  students, 
faculty,  and  researchers,  in  contrast  to  library 

i n t e rme  diaries.] 

(4)  With  respect  to  college  and  university  interest  in  offering 
Physical  Science  and  Engineering  students  an  opportunity  to 
learn  the  principles  and  concepts  of  online  IS&R  systems  and 
interact  with  such  systems,  only  2.5%  of  the  respondents 
replied  in  the  negative;  67.7%  responded  ”YES" , 21.7% 
undecided,  and  7.5%  responded  that  they  are  presently  doing 
so  . 

[Results  indicate  strong  interest  in  the  areas  that  our 
educational  programs  are  addressing.] 

(5)  Funding  was  identified  as  the  major  obstacle  to  course 
implementation  (82.1%). 

[Our  PC  R&D  activities  are  addressing  a number  of  potential 
solutions  to  the  known  high  costs  (vendor  search  time  costs, 
telephone  costs,  te 1 econxnuni cat  ions  costs)  of  providing 
substantive,  online,  hands-on  usage  of  large-scale  IS&R 
systems  . ] 

(6)  An  overwhelming  majority  (86.4%)  of  the  colleges  and 

universities  responding  indicated  interest  in  incorporating 
a pre-packaged  program  (as  we  are  developing)  into  their 
curriculum  when  such  programs  become  available.  Again,  the 
most  frequently  mentioned  qualification  (81.5%)  was  funding 
support . 

[Results  again  represent  strong  justification  for  our 
programs  and  strong  justification  for  our  planned  cost 
reduction  approaches  via  PC  R&D  activities.] 

(7)  With  respect  to  the  types  of  educational  material  to  be 
incorporated  within  the  pre-packaged  educational  programs, 
respondents  indicated  their  desire  for  virtually  all  of  the 
types  of  educational  material  that  we  are  planning  to 
develop,  including  course  syllabi  (73.5%),  hands-on  usage 
assignments  and  keys  (65.2%),  support  handouts  (62.1%), 
workbooks  (60.6%),  overhead  transparencies  (55.3%),  lesson 
plans  (53.8%),  textbooks  (51.5%),  homework  assignments  and 
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keys  (49.2%),  v i deo t ape s / f i 1ms  (47.7%),  and  bibliographies 
(43.2%).  Only  discussion  topics  (39.4%)  and  examinations 
and  keys  (38.6%)  were  requested  by  less  than  40%  of  the 
respondent  s . 

[Again,  the  results  provide  strong  justification  for  the 
need  for  the  types  of  educational  materials  that  we  are 
developing  and  incorporating  within  the  educational 
programs  . ] 

The  complete  details  and  supporting  documents  associated 
with  our  progress  within  the  Needs  Analysis  Phase  of  the  contract 
work  can  be  found  in  items  2.1  through  2.4  of  the  attachment. 


III.  Course  Development  Phase 


During  FY  1983-1984,  the  most  substantial  amount  of  progress 
that  was  made  revolved  around  the  development  of  the  course 
materials  themselves. 

Massive  amounts  of  time  were  dedicated  to  the  preparation  of 
course  development  standards  for  ensuring  the  structured, 
standardized,  and  consistent  development  of  all  interrelated 
course  materials  (see  items  3.1,  3.2,  and  3.3  in  the  attachment) 
and  to  the  initial  drafting,  multiple  review,  and  subsequent 
finalization  of  very  strong  preliminary  versions  of  the  following 
course  materials:  integrated  outline  of  course  visuals  (item 
3.4),  course  visuals  (item  3.S),  course  lesson  plans  (item  3.6), 
course  homework  assignments  and  answer  keys  (item  3.7),  and 
course  NASA  RECON  usage  assignments  and  answer  keys  (item  3.8). 

The  Course  Materials  Development  Diagram,  presented  on  the 
following  page,  illustrates  a schematic  of  the  interrelationships 
and  precedence  dependencies  that  we  are  incorporating  within  the 
development  of  the  course  materials. 

As  just  two  examples  of  the  productivity  of  our  efforts  to 
date,  we  have  already  produced  490  visuals  (item  3.5)  and  lesson 
plans  for  48  interrelated  course  lesson  sequences  (item  3.6). 
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COURSE  MATERIALS  DEVELOPMENT  DIAGRAM 
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IV.  Working  Paper  Series  Information  Dissemination 


In  recognition  of  the  importance  of  widespread  information 
dissemination  concerning  the  educational  programs  that  we  are 
developing  in  preparation  for  the  ultimate  widespread 
distribution  of  these  programs  to  colleges  and  universities 
throughout  the  United  States,  a formal  project  working  paper 
series  has  been  established  to  provide  one  such  information 
dissemination  mechanism. 

As  with  the  development  of  all  course  materials  themselves, 
the  initial  task  within  this  dissemination  mechanism  development 
process  was  the  definition  of  a complete,  consistent,  and 
standardized  set  of  working  paper  series  standards  (see  item  4.1 
in  the  attachment). 

With  the  availability  of  such  standards,  six  working  paper 
series  entries  have  been  completed  to  date  (see  items  4.2  through 
4.7  in  the  attachment).  These  working  paper  series  entries  have 
addressed  such  important  state-of-the-art  issues  within 
interactive  information  storage  and  retrieval  systems  as  the 
man/machine  interface  (item  4.5),  knowledge-based  systems  (item 
4.6),  and  natural  language  query  systems  (item  4.7). 


V.  PC  R&O  Supportive  Research  and  PC  R&D  Working  Paper  Series 


The  USL  NASA  PC  R&D  Project  was  initiated  in  an  effort  to 
explore  the  possible  cost-effective  utilizations  of  personal 
computers  as  support  R&D  tools  for  the  educational  program 
development  and  distribution  phases  and  as  tools  for  use  by 
engineers  and  scientists  in  the  processing  of  information.  Recent 
advances  in  personal  computer  technology  and  resultant  increases 
in  the  performance/cost  ratio  of  these  machines  has  made  them 
increasingly  attractive  replacements  for  terminals  as  a method  of 
accessing  remote  information  systems.  The  information  processing 
capabilities  associated  with  personal  computers  make  them 
particularly  attractive  to  engineering  and  scientific  personnel 
who  desire  both  local  processing  capabilities  and  access  to 
remote  information. 

The  primary  direction  of  research  efforts  initiated  by  the 
project  has  been  the  development  of  a research  environment  to  be 
utilized  by  the  project  and  the  development  of  specifications  for 
a number  of  activities  addressing  individual  tasks  within  the 
overall  scope  of  the  project.  The  research  environment 
development  is  a continuous  process  which  includes  the  evaluation 
and  testing  of  both  hardware  and  software  tools.  All 
specifications  are  developed  with  the  goal  of  maintaining  maximum 
flexibility  and  portability.  The  environment  available  for  use 
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by  project  members  will  therefore  continue  to-  evolve  over  time. 

The  following  general  goals  represent  a framework  for  these 
development  efforts: 

1.  Create  an  environment  for  PC  research  and  development 
activities. 

2.  Develop  an  integrated  PC— based  environment  for 

scientific  and  engineering  professionals. 

3.  Provide  PC-based  instructional  tools  for  training  in  the 
use  of  information  storage  and  retrieval  systems 
(IS&Hs). 

These  goals  will  be  achieved  by  specifying  objectives  and 
initiating  tasks  to  accomplish  those  objectives.  The  following  is 
a list  of  currently  identified  objectives. 

OBJECTIVES: 

1.  The  objectives  for  establishing  a PC  R&D  environment 
inc lude : 

1.1  Continually  evaluate  available  PC  hardware  and 
software  for  potential  incorporation  into  the  PC 
R&D  project  s . 

1.2  Develop  procedures  and  specifications  for  PC  R&D 
act ivi ties. 

1.3  Identify  and  evaluate  candidate  research  and 
development  projects. 

2.  The  objectives  for  developing  an  integrated  PC-based 
environment  include: 

2.1  Develop  a general  means  of  transporting  data 
between  tools  in  the  local  environment. 

2.2  Develop  applications  tools  for  prototyping  an 
integrated  PC-based  environment. 

2.3  Develop  a general  system  for  transparent  sharing 
and  access  of  resources  in  a distributed 
environment . 

2.4  Develop  a consistent  means  for  accessing  resources 
located  in  a remote  processing  environment. 
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3.  The  objectives  for  providing  CAI  tools  for  IS&R  training 
inc lude : 

3.1  Develop  a simulator  for  Computer  Aided  Instruction 
(CAI)  in  the  use  of  IS&R  systems. 

3.2  Develop  a simulator  generator,  retargetable  for 
various  IS&R  systems. 

The  relationships  between  these  PC  R&D  goals  and  objectives 
are  illustrated  in  the  diagram  on  the  following  page. 

During  FY  1983—1984,  considerable  progress  has  been  made  in 
the  establishment  of  this  PC  R&D  environment  (even  though  the  FY 
1983-1984  contract  specifications  did  not  require  even  addressing 
these  issues,  let  alone  providing  formal  deliverables  within  this 
area).  We  do,  however,  believe  that  a cost-effective 
distribution  plan  for  the  educational  programs  under  development 
cannot  be  achieved  without  a formal  support  program  in  the  PC  R&D 
ar ea  • 


Hence,  we  have  initiated  such  a support  program  on  our  own 
as  part  of  our  strategic  planning  for  the  cost-effective 
implementation  of  the  longer  range  educational  program 
distribution  phases  of  this  contract  work. 

Progress  to  date  within  the  USL  PC  R&D  Working  Paper  Series 
(see  items  S.l  through  5.8)  has  included  tasks  such  as  the 
following:  PC  R&D  development  environment  standards  (item  5.3); 
general  specifications  for  the  development  of  a cost-effective 
PC-based  simulator  of  the  NASA  REOON  system  (item  5.4);  PC-based 
statistical  package  support  (item  5.5);  PC-based  distributed 
workstation  specifications  (item  5.6);  the  complete  development 
of  a PC-based  interactive  presentation  development  system  for 
PC-controlled  visual  presentation  sequences  (item  5.7);  and 
detailed  specifications  for  a variety  of  other  sub-projects 
within  the  USL  PC  R&D  Project  (item  5.8). 
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RELATIONSHIPS  BETWEEN  PC  R&D  GOALS  AND  OBJECTIVES 


I ESTABLISH  PC 
I R&D  ENVIROhMENT 
I (Goal  1) 


I INTEGRATED  PC  I 
I WRKSTATION  I 
I (Goal  2)  I 


I PC- BASED  IS&R  I 
I CAI  TOOLS  I 

I (Goal  3)  I 


Objectives  : 


Ob j ect ive  s : 


-Continual  -Local  environment 

eva luat ion. (Ob j l.l)  interface . (Ob j 2.1) 

-Develop  procedures  -Prototype  PC 
& specifications.  works  tat  ion. 

(Obj  1.2)  (Obj  2.2) 


Object i ve  s : 

- 1 S&R  S imu  1 a t o r . 

(Obj  3.1) 

- I S&R  Simulator 
Generator . 

(Obj  2.2) 


-Identify  & evaluate  -Distributed  WS 
candidate  projects.  environment  interface 
(Obj  1.3)  (Obj  2.3) 

-Remote  environment 
interf ace . (Ob j 2.4) 
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VI.  Other  Research  Support  Activities 


A wide  variety  of  additional  research  support  activities 
have  been  conducted  during  FY  1983-1984  in  support  of  the  overall 
goals  and  objectives  of  the  contract  work. 

Very  briefly,  these  additional  activities  have  spanned  areas 
such  as  the  conduct  and  evaluation  of  special  NASA  RECON  training 
sessions  (items  6.1  and  6.2  in  the  attachment);  the  conduct  of 
special  advanced  Computer  Science  Department  course  offerings  to 
ensure  the  involvement  of  a large  body  of  graduate  Computer 
Science  students  in  the  development,  critique,  and  refinement  of 
the  educational  program  mater ial s (items  6.3,  6.4,  and  6.5);  the 
establishment  of  an  effective  R&D  support  environment  on  the 
NRJLTICS  computing  system  (item  6.6);  the  complete  development  of 
a series  of  machine— readable  bibliographic  data  bases  to  support 
the  research  efforts  of  the  contract  team  (items  6.7,  6.8,  and 
6.9);  and  the  complete  development  of  a MULTICS  workbench  to 
provide  an  integrated  set  of  automated  tools  for  use  by  the 
course  materials  development  contract  team  (item  6.10). 


Sl^MARY 


FY  1983-1984  has  been  characterized  by  the  establishment  of 
an  extremely  strong  foundation,  R&D  environment  and  contract  team 
for  the  conduct  of  all  subsequent  phases  of  the  contract  work, 
and  by  the  development  of  a massive  number  of  very  high  quality 
deliverables  pursuant  to  the  educational  programs  and  their 
required  PC  R&D  supportive  activities. 

We  look  forward  to  the  continued  development  and  evolution 
of  these  activities  throughout  the  subsequent  phases  of  this 
contract  work. 
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FY  1983-1984  FINAL  REPORT 
TABLE  OF  CONTENTS 
OF 

DOCUMENTATION/DELIVERABLES 


COMPLETED  TO  DATE 


FY  1983-1984  FINAL  REPORT 


TABLE  OF  CONTENTS 
OF 

DOCUMENTATION/DELIVERABLES  COMPLETED  TO  DATE 


PART  I . PROJECT  MANAGEMENT  AND  CONTROL  DOCIMENTS 


1.1  USL  NASA  TASKS /STATUS  PROJECT  MANAGEMENT  AND  CONTROL 
REPORT,  17p. 


The  primary  project  management  and  control  report  being 
utilized  at  USL  for  project  task/status  assignment, 
monitoring,  and  management.  Report  identifies  tasks  and 
status  via  task  number,  task  status,  responsible  party,  date 
identified,  date  completed,  milestone  date,  and  task 
description. 


1.2  SU  NASA  TASKS /STATUS  PROJECT  MANAGEMENT  AND  CONTROL 
REPORT,  8p. 


The  primary  project  management  and  control  report  being 
utilized  at  SU  for  project  task/status  assig  nme  n t , 
monitoring,  and  management.  Report  identifies  tasks  and 
status  via  task  number,  task  status,  responsible  party,  date 
identified,  date  completed,  milestone  date,  and  task 
descript  ion. 


PART  II.  NEEDS  ANALYSIS  PHASE  DOCUMENTS 


2.1  NEEDS  ANALYSIS  PHASE:  LIST  OF  TARGETED  INSTITUTIONS,  28p 


The  list 
surveying 
uni vers i ty 
distributed 


of  the  institutions  that  were  targ 
via  distribution  of  the  first  coll 
needs  analysis  questionnaire.  Questionna 
to  all  entries  identified  on  this  list. 


eted 

ege 

ires 


for 

and 

were 


1 


2.2  NEEDS  ANALYSIS  PHASE:  QUESTIONNAIRE  COVER  LETTER  TO  TARGETED 
INSTITUTIONS,  2p  . 


The  cover 

1 

together 

wi  t 

ana  lysis 

que 

intent  of 

the 

introduce 

the 

etter  distrib 
h the  first 
s t i onna ire  it 
needs  analys 
que  s t i onna ire 


ut 
c 
s e 
i s 
t 


ed  to 
o 1 1 eg 
If  i 
pha 
o the 


the  targeted  instit 
e and  university 
n order  to  overvi 
se  of  the  contrac 
surveyed  c omnu n i t y . 


u t i ons 
needs 
ew  the 
t and 


2.3  NEEDS  ANALYSIS  PHASE:  NEEDS  ANALYSIS  QUESTIONNAIRE,  6p. 

The  first  college  and  university  needs  analysis 
questionnaire  distributed  to  the  targeted  institutions.  The 
questionnaire  addressed  information  about  the  universities, 
information  storage  and  retrieval  system  usage,  information 
storage  and  retrieval  system  educational  needs,  information 
storage  and  retrieval  system  educational  courses,  and 
c onine  nts  sections. 


2.4  NEEDS  ANALYSIS  PHASE:  NEEDS  ANALYSIS  QUESTIONNAIRE  RESULTS, 
24p. 


The  results  of  the  first  college  and  university  needs 
analysis  questionnaire.  This  document  contains  all 
descriptive  statistics  for  all  questions,  basic  correlation 
analysis,  all  respondents*  comnents,  and  results 
interpretation  sections. 


PART  III.  COURSE  DEVELOPMENT  PHASE  DOCUMENTS 


3.1  COURSE  DEVELOPMENT  PHASE:  STANDARDIZED  COURSE  MATERIAL 
DOCIMENTATION  TEMPLATES,  5p  . 

The  set  of  standardized  course  material  documentation 
templates  for  each  of  the  following  course  materials:  course 
syllabi,  lesson  plans,  homework  assignments,  homework 
assignment  answer  keys,  usage  assignments,  usage  assignment 
answer  keys,  exaunina t ions , and  examination  answer  keys. 
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3.2  CXDimSE  DEVELOPMENT  PHASE:  COURSE  DEVELOPMENT  STANDARDS  FOR 
VISUALS  OUTLINES,  6p. 


The  set  of  deve 
preparing  outlines 


opment  and  documentation 
for  course  visuals. 


s tandards  for 


3.3  COURSE  DEVELOPMENT  PHASE:  COURSE  DEVELOPMENT  STANDARDS  FOR 
VISUALS,  12p. 


The  set  of  development 
preparing  course  visuals. 


and  documentation  standards  for 


3.4 


COURSE  DEVELOPMENT  PHASE:  FIRST  DRAFT  OF  PROPOSED  INTEGRATED 
OUTLINE  OF  COURSE  VISUALS,  15p. 


The  first  draft  of  the  proposed  integrated  outline  of  the 
sys t em- independent  course  visuals  associated  with  a full 
semester  course  offering. 


3.5  COURSE  DEVELOPMENT  PHASE:  FIRST  DRAFT  OF  PROPOSED  COURSE 
VISUALS,  490p. 


The  first  draft  of  the 
visuals  associated  with  a 


proposed  system-independent  course 
full  semester  course  offering. 


3.6 


COURSE  DEVELOPMENT  PHASE:  FIRST  DRAFT  OF  PROPOSED  COURSE 
LESSON  PLANS,  146p. 


The  first  draft  of  the  proposed 
associated  with  a full  semester  course 


course  lesson 
offering . 


plans 


3.7 


COURSE  DEVELOIMENT  PHASE:  FIRST  DRAFT  OF  PROPOSED  COURSE 
HOME(M3RK  ASSIC»MENTS  AND  ANSWER  KEYS,  47p. 


The  first  draft 
and  answer  keys 
offering. 


of  the  proposed  course  homework  assignments 
associated  with  a full  semester  course 
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3.8  CX)URSE  DEVELOPMENT  PHASE:  FIRST  DRAFT  OF  PROPOSED  COURSE 
NASA  RECON  USAGE  ASS IGNVIENTS  , 32p. 


The  first  draft  of  the  proposed  course  NASA  RECON  usage 
assignments  associated  with  a full  semester  course  offering. 


PART  IV.  \SORKING  PAPER  SERIES  DOCUMENTS 


4.1  USL/DBMS  NASA/ RECON  WORKING  PAPER  SERIES  STANDARDS,  36p. 


The  full  set  of  standards  for  the  development,  formatting, 
reviewing,  and  issuance  of  entries  within  the  USL/DBMS 
NASA/ RECON  Working  Paper  Series. 


4.2  "OVERVIEW  OF  THE  NASA/ RECON  EDUCATIONAL,  RESEARCH,  AND 
DEVELOPMENT  ACTIVITIES  OF  THE  COMPUTER  SCIENCE  DEPARTMENTS 
OF  THE  UNIVERSITY  OF  SOUTHWESTERN  LOUISIANA  AND  SOUTHERN 
UNIVERSITY,"  WAYNE  D.  DOMINICK,  USL/DBMS  NASA/ RECON  WORKING 
PAPER  SERIES  REPORT  NIMBER  DBMS  .NASA/ RECON- 1 , 9p. 


An  introduction  to  the  USL/DBMS  NASA/RECON  Working  Paper 
Series  which  has  been  established  to  provide  a foundation 
for  a formal  information  dissemination  mechanism  concerning 
activities  being  performed  pursuant  to  the  NASA/RECON 
contract.  This  entry  also  serves  as  an  index  into  the 
collection  of  Working  Paper  Series  reports. 


4.3  "NASA  RECON:  COURSE  DEVELOPMENT,  ATMINISTRATION,  AND 

EVALUATION,"  WAYNE  D.  DOMINICK  AND  LEROY  ROQUIMDRE , USL/DBMS 
NASA/ RECON  WORKING  PAPER  SERIES  REPORT  NIMBER 
DBMS.  NASA/ RECON- 2,  65p. 


Working  Paper  Series  entry  representing  the  scope  of  the 
initial  contract  proposal  to  NASA. 


4.4  "TRANSPORTABLE,  UNIVERSITY- LEVEL  EDUCATIONAL  PROGRAMS  IN 
INTERACTIVE  INFORMATION  STORAGE  AND  RETRIEVAL  SYSTEMS," 
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WAYNE  D.  DCMINICK  AND  LEROY  ROQUBVDRE,  USL/DBMS  NASA/RECX)N 
AW)RXING  PAPER  SERIES  REPORT  NIMBER  DBMS  .NASA/RECX)N-3  , 16p. 


Working  Paper  Series  entry  representing  the  abstract  and 
visuals  associated  with  the  above  named  presentation 
delivered  at  the  11th  Annual  Conference  of  the  Mid-South 
Association  for  Educational  Data  Systems.  This  presentation 
overviewed  the  educational  aspects  of  the  NASA  contract 
activities. 


4.5  "THE  MAN/MACHINE  INTERFACE  IN  INFORMATION  RETRIEVAL: 
PROVIDING  ACCESS  TO  THE  CASUAL  USER,”  MARTIN  GRANIER, 
USL/DBMS  NASA/RECON  VORKING  PAPER  SERIES  REPORT  NIMBER 
DBMS. NASA/ RECON- 4,  69p. 


Working  paper  series  report  surveying  the  state-of-the-art 
in  high  level  man/machine  interfaces  for  supporting  casual 
user  access  to  interactive  information  storage  and  retrieval 
systems.  Additionally,  capabilities  and  characteristics  of 
selected  specific  systems  are  addressed  within  the  report, 
including  LEXIS,  CONIT,  IIDA,  CITE,  and  CCL. 


4.6  "KNOWLEDGE-BASED  SYSTEMS:  A PRELIMINARY  SURVEY  OF  SELECTED 
ISSUES  AND  TECHNIQUES,”  SRINU  KAVI  , USL/DHs4S  NASA/RECON 
AWRKING  PAPER  SERIES  REPORT  NUVIBER  DHVIS  .NASA/ RECON- 5 , 102p. 


Working  paper  series  report  surveying  the  state-of-the-art 
in  knowledge-based  systems  (expert  systems),  including 
issues  related  to  knowledge  representation,  knowledge  bases, 
cognitive  engine  strategies,  user  interfaces  for 
knowl  edg e -ba s ed  systems,  and  application  considerations. 


4.7  "CONCEPTS  AND  IMP  LEMENAT  IONS  OF  NATURAL  LANGUAGE  QUERY 
SYSTEMS,”  I-HSIUNG  LIU,  USL/DBMS  NASA/ RECX)N  WORKING  PAPER 
SERIES  REPORT  NIMBER  DBMS  .NASA/ RECON- 6 , 46p. 


Working  paper  series  report  surveying  the  state-of-the-art 
in  natural  language  query  systems  for  information  systems, 
including  issues  related  to  hierarchies  of  user  languages, 
query  language  analyzers,  dialog  controllers,  and 
synthesizers,  and  implementation  considerations  for  natural 
language  query  systems. 
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PART  V. 


PC  R&D  SPECIFICATIONS  DOCUMENTS  AND 
PC  R&D  \nDRKING  paper  SERIES  DOCUMENTS 


5.1  ”AN  OVERVIEW  OF  THE  USL/DEMS  NASA/PC  R&D  PROJECT  \VDRKING 
PAPER  SERIES,”  WAYNE  D.  DCMINICK,  USL/DBMS  NASA/PC  R&D 
WORKIhKj  PAPER  SERIES  REPORT  NUMBER  DBMS. NASA/PC  R&D-l,  6p. 

An  introduction  to  the  USL/DEMS  f^ASA/PC  R&D  Working  Paper 
Series  which  has  been  established  to  provide  a foundation 
for  both  a formal  and  informal  information  dissemination 
mechanism  concerning  PC-based  research  and  development 
activities  being  performed  pursuant  to  the  NASA  contract. 
This  entry  also  serves  as  an  index  into  the  collection  of 
Working  Paper  Series  reports. 


5.2  ”THE  USL  NASA  PC  R&D  PROJECT:  GENERAL  SPECIFICATIONS  OF 

OBJECTIVES,”  WAYNE  D.  DCMINICK,  USL/DEMS  NASA/PC  R&D  WORKING 
PAPER  SERIES  REPORT  NIMBER  DEMS  .NASA/PC  R&D-2,  6p. 


The  general  specifications  of  the  objectives  of  the  USL/DEMS 
NASA  PC  R&D  Project,  a Research  and  Development  Project 
initiated  at  USL  in  order  to  address  future  R&D  issues 
related  to  the  PC— based  processing  environments  acquired 
pursuant  to  the  NASA  contract  work,  namely,  the  I®d  PC/XT 
s y s t ems  . 


5.3  ”THE  USL  NASA  PC  R&D  DEVELOPMENT  ENVIRONMENT  STANDARDS,” 
DENNIS  R.  MOREAU,  USL/DEMS  NASA/PC  R&D  \\DRKING  PAPER  SERIES 
REPORT  NUMBER  DEMS. NASA/ PC  R&D-3  , 8p. 


The  development  environment  standards  which  have  been 
established  in  order  to  control  usage  of  the  IBM  PC/XT 
development  systems  and  to  prevent  interference  between 
projects  being  concurrently  developed  on  the  PC’s.  The 
standards  address  the  following  areas:  scheduling  PC 
resources;  login/Iogout  procedures;  training;  file  naming 
conventions;  hard  disk  organization;  diskette  care;  backup 
procedures;  and  copying  policies. 


6 


5.4  "GENERAL  SPECIFICATIONS  FOR  THE  DEVELOPMENT  OF  A PC-BASED 
SIMULATOR  OF  THE  NASA  RECON  SYSTEM,  ” SPIROS 
TRIANTAFYLLOPOULOS  , USL/DBMS  NASA/PC  R&D  W3RKING  PAPER 
SERIES  REPORT  NUMBER  DBMS. NASA/PC  R&D-4,  2 Ip. 

The  general  specifications  for  the  design  and  implementation 
of  an  IBM  PC/XT-based  simulator  of  the  NASA  RECON  system, 
including  record  designs,  file  structure  designs,  command 
language  analysis,  program  design  issues,  error  recovery 
considerations,  and  usage  monitoring  facilities.  Once 
implemented,  such  a simulator  will  be  utilized  to  evaluate 
the  effectiveness  of  simulated  information  system  access  in 
addition  to  actual  system  usage  as  part  of  the  total 
educational  programs  being  developed  within  the'  NASA 
contract . 


5.5  "GENERAL  SPECIFICATIONS  FOR  THE  DEVELOIMENT  OF  A USL  NASA  PC 
R&D  STATISTICAL  ANALYSIS  SUPPORT  PACKAGE,"  J I NOUS  BAS SARI 
AND  SPIROS  TRIANTAFYLLOPOULOS,  USL/DBMS  NASA/PC  R&D  WORKING 
PAPER  SERIES  REPORT  NIMBER  DBMS. NASA/PC  R&D-5 , 14p. 

The  USL  NASA  PC  R&D  statistical  analysis  support  package  is 
designed  to  be  a three  level  package  to  al low  statistical 
analysis  for  a variety  of  applications  within  the  USL  D^dS 
NASA  Contract  work.  The  design  addresses  usage  of  the 
statistical  ' facilities  as  a library  package,  as  an 

interactive  statistical  analysis  system,  and  as  a batch 
processing  package. 


5.6  "GENERAL  SPECIFICATIONS  FOR  THE  DEVELOIWdENT  OF  A USL  NASA  PC 
R&D  DISTRIBUTED  WORKSTATION,”  FRANK  Y.  CHIM,  USL/DHMS 
NASA/PC  R&D  WORKING  PAPER  SERIES  REPORT  NtMBER  DBMS  .NASA/ PC 
R&D-6,  lOp. 


This  document  defines  the  general  specifications  for  the 
development  of  a PC-Based  distributed  workstation  (PCDWS) 
for  an  information  storage  and  retrieval  systems 
environment.  This  research  proposes  the  development  of  a 
PCD5VS  prototype  as  part  of  the  USL/DBMS  NASA/PC  R&D  project 
in  the  PC-Based  workstation  environment. 
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5.7  ”THE  USL  NASA  PC  R&D  INTERACTIVE  PRESENTATION  DEVELOFTV1ENT 
SYSTEM,”  DENNIS  R.  M)REAU,  USL/DEIMS  NASA/ PC  R&D  WORKING 
PAPER  SERIES  REPORT  NUMBER  DKvlS  .NASA/PC  R&D-7  , 8p. 

The  Interactive  Presentation  Development  System  (IPDS)  is  a 
highly  interactive  system  for  creating,  editing,  and 
displaying  video  presentation  sequences,  e.g.,  for 
developing  and  presenting  displays  of  instructional  material 
similar  to  overhead  transparency  or  slide  presentations. 
However,  since  this  system  is  PC-based,  users  (e.g., 
instructors)  can  step  through  sequences  forward  or  backward, 
focusing  attention  to  areas  of  the  display  with  special 
cursor  pointers.  Additionally,  screen  displays  may  be 
dynamically  modified  during  the  presentation  to  show 
assignments  or  to  answer  questions,  much  like  a traditional 
blackboard.  This  system  is  now  implemented  at  USL  for  use 
within  the  piloting  phases  of  the  NASA  contract  work. 


5.8  ”THE  USL  NASA  PC  R&D  PRO  JECT : DETAILED  SPECI FICATIONS  OF 

OBJECTIVES,”  FRANK  Y.  CHUM,  PHILIP  P.  HALL,  DENNIS  R. 
MJREAU,  AND  SPIROS  TRIANTAFYLLOPOULOS , USL/DEMS  NASA/PC  R&D 
WORKING  PAPER  SERIES  REPORT  NIMBER  DBMS  .NASA/PC  R&D-8  , 21p. 

This  document  represents  the  specifications  for  a number  of 
projects  which  are  to  be  implemented  within  the  USL  NASA  PC 
R&D  Project.  The  goals  and  objectives  of  the  PC  development 
project  and  the  interrelationships  of  the  various  components 
are  discussed.  Six  individual  projects  are  described.  They 
are  a NASA/RECX)N  simulator,  a user  interface  to  multiple 
remote  information  systems,  evaluation  of  various  personal 
computer  systems,  statistical  analysis  software  development, 
interactive  presentation  system  development,  and  the 
development  of  a distributed  processing  environment.  The 
relationships  of  these  projects  to  each  other  and  to  the 
goals  and  objectives  of  the  overall  project  are  also 
di scus  sed. 
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PABT  VI . 


OTHER  RESEARCH  SUPPORT  DOCUMENTS 


6.1  NASA/RECON  SPECIAL  TRAINING  WORKSHOP  AT  USL:  WORKSHOP 

AGENDA,  LIST  OF  PARTICIPANTS,  AND  COMPLETION 

CERTIFICATES,  4p . 


The  workshop  agenda,  list  of  participants,  and  a sample  copy 
of  the  completion  certificate  associated  with  the  NASA/RECON 
Special  Training  Workshop  held  at  USL,  January  31,  1984 

February  2,  1984. 


6.2  NASA/ RECON  SPECIAL  TRAINING  WORKSHOP  AT  USL:  PARTICIPANTS 

EVALUATION  FORM  SOVMARY  RESULTS,  lOp. 


The  summary  statistical  evaluation  results  and  participants 
conments  associated  with  the  evaluation  of  the  NASA/RECON 
Special  Training  Workshop  held  at  USL,  January  31,  1984  - 
February  2,  1984. 


6.3  USL  COMPUTER  SCIENCE  DEPARTMENT  COURSE  CMPS669  ”ADVANCED 
TOPICS  IN  COMPUTER-BASED  INFORMATION  SYSTEMS  (NASA  RECON)” 
COURSE  SYLLABUS,  SPRING  1984,  7p. 


Syllabus  for  a graduate 
Spring  Semester  1984 
into,  and  involvement 
activities. 


course  offered  at  USL  during  the 
pursuant  to  additional  student  input 
in  the  NASA  contract  educational 


6.4  USL  CMPS669  STUDENT  TASKS/ASS IGhMENTS  TASKING  SPECIFICATIONS 
DOCUMENT:  SPRING  SEMESTER,  1984,  lOp. 


Specification  of  specific  tasks  being  addressed  by  students 
enrolled  in  the  aforementioned  CMPS669  course  offered  at  USL 
during  the  Spring  Semester  1984. 
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6.5  USL  CMPS669  STUDENT  TASKS/ASS IGhMENTS  TASKING  SPECIFICATIONS 
DOCIMENT:  SlMwER  SEMESTER,  1984,  lip. 


Specifications  of  specific  tasks  being  addressed  by  students 
participating  in  a second  graduate  information  systems 
course  (CMPS669)  at  USL  during  the  Summer  Semester  1984 
pursuant  to  additional  student  input  into,  and  involvement 
in  the  NASA  contract  educational  activities. 


6.6  USL  DBMS  R&D  PROJECT  NASA/RECON  MLJLTICS  DIRECTORY 
STRUCTURE,  28 p. 


Identification  of  the  automated  directory  structure  which 
has  been  established  on  the  USL  MLJLTICS  system,  under  the 
auspices  of  the  Computer  Science  Department’s  D^^  R&D 
Project,  in  order  to  provide  aut oma ted  support  for  the 
educational,  research  and  development  tasks  being  addressed 
within  the  scope  of  the  NASA/RECON  contract. 


6.7  USL  DBMS  NASA/RECON  BIBLIOGRAPHIC  SUPPORT  DATA  BASE 
STATUS,  33p. 


The  status  of  a bibliographic  support  data  base  which  has 
been  created  at  USL  in  order  to  provide  local  searchable 
access  to  all  files  being  maintained  and  utilized  as  part  of 
the  NASA/ RECON  contract  activities. 


6.8  USL  DHytS  IS&R  BIBLIOGRAPHIC  SUPPORT  DATA  BASE  STATUS,  139p. 

The  status  of  a bibliographic  support  data  base  which  has 
been  created  at  USL  in  order  to  provide  local  searchable 
access  to  the  primary  information  storage  and  retrieval 
literature  (books,  journal  articles,  conference  proceedings, 
technical  reports,  government  reports,  and  so  on)  being 
utilized  by  the  NASA  contract  team  pursuant  to  the 
development  of  all  educational  materials. 
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6.9 


USL  DBMS  PME  BIBLIOGRAPHIC  SUPPORT  DATA  BASE  STATUS , 47p. 


The  status  of  a bibliographic  support  data  base  wh i ch  has 
been  created  at  USL  in  order  to  provide  local  searchable 
access  to  the  primary  information  system  performance 
measurement  and  evaluation  literature  (books,  journal 
articles,  conference  proceedings,  technical  reports, 
government  reports,  and  so  on)  being  utilized  by  the  NASA 
contract  team  pursuant  to  the  development  of  all  educational 
ma  t e r i a 1 s . 


6.10  USL/DBMS  NASA/ REO)N  NRJLT ICS  \«)RKBENCH  SPECIFICATIONS,  6p. 


The  specifications  of  an  R&D  workbench  to  be  implemented  on 
the  USL  NRJLTICS  system  in  order  to  provide  centralized 
control  over,  and  access  to  all  contract  work  being 
performed  utilizing  the  MULTICS  system  as  the  host 
processing  environment.  Versions  1 and  2 of  the  MULTICS 
workbench,  providing  centralized  menu  control,  project 
management  and  control  report  generation,  mailing  list 
processors,  electronic  mail  processors,  document  pre-  and 
post -processors  including  laser  printer  format  generators, 
tape  backup  processors,  NASA  RECON  data  base  document 
control  processors,  and  access  control  have  been  comp  1 e t e ly 
implemented,  tested,  and  are  in  operational  status.  Further 
enhancements  to  the  workbench  are  currently  in  design 
stages. 
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ATTACHMENT  1.1 


USL  NASA  TASKS/STATUS  PROJECT 
MANAGEMENT  AND  CONTROL  REPORT 
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TASK  TASK  RESPONSIBLE  DATE  DATE  MILESTONE 

NUMBER  STATUS  PARTY  IDENTIFIED  COMPLETED  DATE  TASK  DESCRIPTION 
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37.  COMPLETED  WDD/ST  01/18/84  02/20/84  02/23/84  After  Completion  of  NASA  RECON  Workshop  at  USL, 

Provide  Feedback  to  John  Wilson,  NASA,  HQ,  and 
to  Philip  Eckert,  NASA,  ST  I on 
Quality/Appropriateness  of  the  Intensive 
Wo  r k shop . 
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48.  COMPLETED  WDD  01/21/84  01/22/84  01/30/84  Prepare  First  USL  Progress/Status  Report  to  Leroy 

Roquemore  Southern  University,  on  the  USL 
Progress  on  the  Contract  Work. 


TASK  TASK  RESPONSIBLE  DATE  DATE  MILESTONE 

NUMBER  STATUS  PARTY  IDENTIFIED  COMPLETED  DATE  oTASK  DESCRIPTION 
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ATTACHMENT  2.1 


NEEDS  ANALYSIS  PHASE: 


LIST  OF  TARGETED  INSTITUTIONS 


Vice-President,  Academic  Affairs 
Univ  of  Alaska 
Fairbanks  AK  99701 

Vice-President,  Academic  Affairs 
Univ  of  Arizona 
Tucson  AZ  85721 

Vice-President,  Academic  Affairs 
California  Inst,  of  Technology 
Pasadena  CA  91125 

Vice-President,  Academic  Affairs 
Univ  of  California 
Lawrence  Livermore  Lab 
Livermore  CA  94550 

Vice-President,  Academic  Affairs 
Colorado  State  Univ 
Ft  Collins  CO  80523 

Vice-President,  Academic  Affairs 
Come  1 1 Univ 
Ithaca  NY  14583 

Vice-President,  Academic  Affairs 
Univ  of  Dayton 
Research  Institute 
Dayton  OH  45469 

Vice-President,  Academic  Affairs 
Arizona  State  Univ 
Tempe  AZ  85257 

Vice-President,  Academic  Affairs 
Univ  of  Arkansas 
Fayetteville  AR  72701 

Vice-President,  Academic  Affairs 
Univ  of  California 
Lawrence  Berkeley  Lab 
Berkeley  CA  94720 

Vice-President,  Academic  Affairs 
Univ  of  California 
Los  Alamos  National  Lab 
Los  Alamos  hM  87545 

Vice-President,  Academic  Affairs 
Univ  of  Colorado 
Boulder  CO  80309 


Vice-President,  Academic  Affairs 
Dartmouth  College 
Hanover  NH  03755 

Vice-President,  Academic  Affairs 
Embry  Riddle  Aeronautical  Univ 
Daytona  Bch  FL  32014 

Vice-President,  Academic  Affairs 
Florida  Institute  of  Technology 
Melbourne  FL  32901 

Vice-President,  Academic  Affairs 
Georgia  Institute  of  Technology 
Atlanta  GA  30332 

Vice-President,  Academic  Affairs 
Johns  Hopkins  Univ 
Laurel  MD  20707 

Vice-President,  Academic  Affairs 
Massachusetts  Inst,  of  Technolog 
Cambridge  MA  02139 

Vice-President,  Academic  Affairs 
Univ  of  Michigan 
Ann  Arbor  MI  48109 

Vice-President,  Academic  Affairs 
Univ  of  Mi  s s our i -Ro 1 1 a 
Rol  la  MO  65401 

Vice-President,  Academic  Affairs 
Pennsylvania  State  Univ 
State  Colleege  PA  16801 

Vice-President,  Academic  Affairs 
Princeton  Univ 
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Univ  of  Kansas 
Lawrence  KS  66045 


Vice-President,  Academic  Affairs 
Massachusetts  Inst,  of  Technolog 
Lexington  MA  02173 


Vice-President,  Academic  Affairs 
Univ  of  Alabama 
University  AL  35486 
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Univ  of  Minnesota 
Minneapolis  MN  55455 
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Albuquerque  bM  87131 
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Pittsburgh  PA  15260 
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Purdue  Univ 
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Vice-President,  Academic  Affairs 
Univ  of  Arkansas 
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Vice-President,  Academic  Affairs 
Ausurn  Univ 
Auburn  AL  36849 

Vice-President,  Academic  Affairs 
Au stin  State  Un i v 
Nacogdoches  TX  75961 

Vice-President,  Academic  Affairs 
Brande i s Univ 
Waltham  MA  02254 


Vice-President,  Academic  Affairs 
Rockefeller  Univ 
New  York  NY  10021 

Vice-President,  Academic  Affairs 
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Los  Angeles  CA  90007 


Vice-President,  Academic  Affairs 
Areospace  Technoogical  Inst 
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Vice-President,  Academic  Affairs 
Univ  of  Alabama  in  Birmingh2un 
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Vice-President,  Academic  Affairs 

Texas  A^i  Univ 
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Vice-President,  Academic  Affairs 

Univ  of  Utah 
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Alii anc  e College 
Cambrg  Spgs  PA  16403 

Vice-President,  Academic  Affairs 
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Vice-President,  Academic  Affairs 
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Durant  OK  74701 

Vice-President,  Academic  Affairs 
Utah  State  Univ 
Logan  UT  84322 


Vice-President,  Academic  Affairs 
Bowling  Green  State  Univ 
Bowling  Green  OH  43403 

Vice-President,  Academic  Affairs 
Brevard  Conmunity  College 
Melbourne  FL  32935 


Vice-President,  Academic  Affairs 
Academy  of  Aeronautics 
Flushing  NY  11371 

Vice-President,  Academic  Affairs 
Univ  of  Alabama  Huntsville 
Huntsville  AL  35899 


Vice-President,  Academic  Affairs 
Univ  of  Bridgeport 
Bridgeport  CT  06602 

Vice-President,  Academic  Affairs 
Brown  Univ 
Providence  RI  02912 


Vice-President,  Academic  Affairs 
California  State  Polytechnic  Uni 
Pomona  CA  91768 

Vice-President,  Academic  Affairs 
Univ  of  California/Berkeley 
Berkeley  CA  94720 

Vice-President,  Academic  Affairs 
Univ  of  Ca 1 i f o rn i a /Ri ve r s i de 
Riverside  C A 92521 

Vice-President,  Academic  Affairs 
Univ  od  Ca 1 i f o r n i a / S an t a Barbara 
Santa  Barbara  CA  93106 

Vice-President,  Academic  Affairs 
Carnegie  Mellon  Univ 
Pittsburgh  PA  15213 

Vice-President,  Academic  Affairs 
Catholic  Univ  of  America 
Washington  DC  20064 


Vice-President,  Academic  Affairs 
Univ  of  Chicago 
Chicago  IL  60637 

Vice-President,  Academic  Affairs 
Univ  of  Cincinnati 
Cincinnati  OH  45221 

Vice-President,  Academic  Affairs 
Cl  a r emon t Co  lieges 
Claremont  CA  91711 

Vice-President,  Academic  Affairs 
Clems  on  Univ 
Clenson  SC  29631 

Vice-President,  Academic  Affairs 
Colorado  School  of  Mines 
Golden  CO  80401 

Vice-President,  Academic  Affairs 
Univ  of  Connecticut 
Storrs  CT  06268 


Vice-President,  Academic  Affairs 
Brigham  Young  Univ 
Provo  UT  84602 


Vice-President,  Academic  Affairs 
Univ  of  Detroit 
Detroit  MI  48221 


Vice-President,  Academic  Affairs 
California  State  Coll  Stanislaus 
Turlock  CA  95380 


Vice-President,  Academic  Affairs 
Duke  Univ 
Durham  NC  27706 


Vice-President,  Academic  Affairs 
California  State  Univ  Fullerton 
Fullerton  CA  92634 

Vice-President,  Academic  Affairs 
Univ  of  Ca 1 i f o rn i a/Dav i s 
Davis  CA  95616 

Vice-President,  Academic  Affairs 
Univ  of  Ca 1 i f o rn i a / San  Francisco 
San  Francisco  CA  94143 

Vice-President,  Academic  Affairs 
Univ  of  California 
Los  Angeles  CA  90024 

Vice-President,  Academic  Affairs 
Case  Western  Reserve  Univ 
Cleveland  OH  44106 


Vice-President,  Academic  Affairs 
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Vice-President,  Academic  Affairs 
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New  York  NY  10031 

Vice-President,  Academic  Affairs 
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Vice-President,  Academic  Affairs 
Cleveland  State  Univ 
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Vice-President,  Academic  Affairs 
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Vice-President,  Academic  Affairs 
Drexel  Univ 
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Vice-President,  Academic  Affairs 
Duquesne  Univ 
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Vice-President,  Academic  Affairs 
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Vice-President,  Academic  Affairs 
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Vice-President,  Academic  Affairs 
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Vice-President,  Academic  Affairs 
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Wo  r c e s t e r MA  01610 
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Vice-President,  Academic  Affairs 
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Vice-President,  Academic  Affairs 

•Gonzaga  Univ 
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Vice-President , Ac  ad emi  c Af  fairs 
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Vice-President,  Academic  Affairs 
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Vice-President,  Academic  Affairs 
Ho  f s t r a Un  i v 
Hempstead  NY  11550 
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Vice-President,  Academic  Affairs 
Howa  r d Un  i v 
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Vice-President,  Academic  Affairs 
George  Washington  Univ 
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Vice-President,  Academic  Affairs 
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Vice-President,  Academic  Affairs 
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Vice-President,  Academic  Affairs 
I owa  State  Univ 
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Univ  of  Miami 

Coral  Gables  FL  33124 
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Univ  of  Illinois 
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Houston  TX  77006 

Vice-President,  Academic  Affairs 
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Univ  of  Maryland 
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Vice-President,  Academic  Affairs 
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Vice-President,  Academic  Affairs 
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Vice-President,  Academic  Affairs 
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Vice-President,  Academic  Affairs 
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Vice-President,  Academic  Affairs 
Mi  ami  Un  i v 
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Vice-President,  Academic  Affairs 
Univ  of  Louisville 
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Vice-President,  Academic  Affairs 
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Bronx  NY  10471 

Vice-President,  Academic  Affairs 
Univ  of  Maryland 
College  Park  M)  20742 


Vice-President,  Academic  Affairs 
Michigan  State  Univ 
East  Lansing  Ml  48824 

Vice-President,  Academic  Affairs 
Univ  of  Michigan 
Ann  Arbor  MI  48109 

Vice-President,  Academic  Affairs 
Univ  of  Mississippi 
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Vice-President,  Academic  Affairs 
Univ  of  Missouri 
Columbia  M)  65211 


Vice-President,  Academic  Affairs 
Norfolk  State  Univ 
Norfolk  VA  23501 


Vice-President,  Academic  Affairs 
Univ  of  Nebraska 
Lincoln  NE  68588 

Vice-President,  Academic  Affairs 
New  Jersey  Inst,  of  Technology 
Newark  NJ  07102 

Vice-President,  Academic  Affairs 
New  Mexico  State  Univ 
Las  Cruses  bM  88003 

Vice-President,  Academic  Affairs 
New  York  State  Coll  of  Ceramics 
Alfred  NY  14802 

Vice-President,  Academic  Affairs 
New  York  Univ 
New  York  NY  10012 


Vice-President,  Academic  Affairs 
U of  North  Carolina  at  Wilmingto 
Wilmington  NC  28401 

Vice-President,  Academic  Affairs 
Univ  of  North  Carolina 
Chape  1 Hill  NC  27515 

Vice-President,  Academic  Affairs 
Northeast  Louisiana  Univ 
Moroe  LA  71203 

Vice-President,  Academic  Affairs 
Northeastern  Univ 
Boston  MA  02115 

Vice-President,  Academic  Affairs 
Univ  of  Northern  Colorado 
Greeley  CO  80639 


Vice-President,  Academic  Affairs 

•U  of  North  Carolina  at  Charlotte 
Charlotte  NC  28223 

Vice-President,  Academic  Affairs 
North  Carolina  State  Univ 
Raleigh  NC  27650 


Vice-President,  Academic  Affairs 
Northrop  Univ 
Inglewood  CA  90306 

Vice-President,  Academic  Affairs 

Norwich  Univ 

North  Field  VT  05663 


Vice-President,  Academic  Affairs 
Montana  State  Univ 
Bozeman  MT  59717 


Vice-President,  Academic  Affairs 
Ohio  Northern  Univ 
Ada  OH  45810 


Vice-President,  Academic  Affairs 
Univ  of  Nevada 
Reno  NV  89557 

Vice-President,  Academic  Affairs 
New  Mexico  Institute  of  Mining 
and  Technology 
Socorro  87801 

Vice-President,  Academic  Affairs 
Univ  of  New  Orleans 
New  Orleans  LA  70148 

Vice-President,  Academic  Affairs 
New  York  Univ 

•Courant  Institute 
New  York  NY  10012 


Vice-President,  Academic  Affairs 
Univ  of  Oklahoma 
Norman  OK  73019 

Vice-President,  Academic  Affairs 
Univ  of  Oklahoma 
Oklahoma  City  OK  73190 

Vice-President,  Academic  Affairs 
Northeast  Missouri  State  Univ 
Kirksville  M)  63501 

Vice-President,  Academic  Affairs 
Northern  Arizona  Univ 
Flagstaff  AZ  86011 


Vice-President,  Academic  Affairs 
Northern  Illinois  Univ 
Dekalb  IL  60115 


Vice-President,  Academic  Affairs 
Rose-Hulman  Inst  of  Technology 
Terre  Haute  IN  47803 


Vice-President,  Academic  Affairs  Vice-President,  Academic  Affairs 
Northwestern  Univ  Palomar  Conmunity  College 

Evanston  IL  60201  San  Marcos  CA  92069 


Vice-President,  Academic  Affairs 
Univ  of  Notre  Dame 
Notre  Dame  IN  46556 

Vice-President,  Academic  Affairs 
Oh i o State  Un i v 
Columbus  OH  43210 

Vice-President,  Academic  Affairs 
Ok  1 a h oma  State  Un i v 
St i 1 Iwater  OK  74078 

Vice-President,  Academic  Affairs 
Oregon  Health  Sciences  Univ 
Portland  OR  97207 

Vice-President,  Academic  Affairs 

•Oregon  State  Univ 
Corval 1 i s OR  97331 

Vice-President,  Academic  Affairs 
Pennsylvania  State  Univ 
Hershey  PA  17033 

Vice-President,  Academic  Affairs 
Pennsylvania  State  Univ 
Univ  Park  PA  16802 

Vice-President,  Academic  Affairs 
Phi  1 1 ips  Univ 
Enid  OK  73702 

Vice-President,  Academic  Affairs 
Portland  State  Univ 
Portland  OR  97207 

Vice-President,  Academic  Affairs 
Rensselaer  Polyt  e chni c Institute 
Troy  NY  12181 

Vice-President,  Academic  Affairs 
Rochester  Institute  of  Technolog 
Rochester  NY  14623 


Vice-President,  Academic  Affairs 
Pennsylvania  State  Univ 
Capitol  Campus 
Mi  dd 1 e t own  PA  17  057 

Vice-President,  Academic  Affairs 
Univ  of  Pennsylvania 
Ph iladelphia  PA  19104 

Vice-President,  Academic  Affairs 
Polytechnic  Institute  of  New  Yor 
Farmingdale  NY  11735 

Vice-President,  Academic  Affairs 
Providence  Co  liege 
Providence  RI  02918 

Vice-President,  Academic  Affairs 
Univ  of  Rhode  Island 
Kingston  RI  02881 

Vice-President,  Academic  Affairs 
Univ  of  Rochester 
Rochester  NY  14627 

Vice-President,  Academic  Affairs 
Rutgers  Univ 
Piscataway  NJ  08854 

Vice-President,  Academic  Affairs 
Saint  Louis  Univ 
Cahokia  IL  62206 

Vice-President,  Academic  Affairs 
San  Diego  State  Univ 
San  Diego  CA  92182 

Vice-President,  Academic  Affairs 
Univ  of  Santa  Clara 
Santa  Clara  CA  95053 

Vice-President,  Academic  Affairs 
Univ  of  South  Carolina 
Columbia  SC  29208 


Vice-President,  Academic  Affairs 
Univ  of  South  Dakota 
Vermi  1 1 ion  SD  57069 

Vice-President,  Academic  Affairs 
Southern  Illinois  Univ 
Carbondale  IL  62901 

Vice-President,  Academic  Affairs 
St  Vincent  College 
Latrobe  PA  15650 


Vice-President,  Academic  Affairs 
State  Univ.  System  of  Florida 
Cpe  Canaveral  FL  32920 

Vice-President,  Academic  Affairs 
Syracuse  Uni  vers i ty 
Syracuse  NY  13210 

Vice-President,  Academic  Affairs 
Tennessee  Technological  Univ 
Cookevi 1 le  TN  38505 


Vice-President,  Academic  Affairs 
State  Univ  of  New  York 
Binghamton  NY  13901 

Vice-President,  Academic  Affairs 
Saint  Louis  Univ 
St  Louis  MD  63108 


Vice-President,  Academic  Affairs 
Univ  of  Texas  at  Arlington 
Arlington  TX  76019 

Vice-President,  Academic  Affairs 
Texas  Christian  Univ 
Fort  Worth  TX  76129 


Vice-President,  Academic  Affairs 
San  Jose  State  Univ 
San  Jose  CA  95192 


Vice-President,  Academic  Affairs 
Texas  Tech  Univ 
Lubbock  TX  79409 


Vice-President,  Academic  Affairs 
Slippery  Rock  State  College 
Slippery  Rock  PA  16057 

Vice-President,  Academic  Affairs 
South  Dakota  Sch  of  Mines  & Tech 
Rapid  City  SD  57701 

Vice-President,  Academic  Affairs 
Univ  of  Southern  California 
Tucson  AZ  85713 

Vice-President,  Academic  Affairs 
Southern  Methodist  Univ 
Dallas  TX  75275 

Vice-President,  Academic  Affairs 
Stanford  Univ 
Stanford  CA  94305 

Vice-President,  Academic  Affairs 
State  Univ  of  New  York  at  Albany 
Albany  NY  12222 

Vice-President,  Academic  Affairs 
State  Univ  of  New  York  at  Buffal 
Amherst  NY  14260 


Vice-President,  Academic  Affairs 

Univ  of  Texas 

San  Antonio  TX  78284 

Vice-President,  Academic  Affairs 
State  University  of  New  York 
At  Stony  Brook 
Stony  Brook  NY  11794 

Vice-President,  Academic  Affairs 
Stevens  Institute  of  Technology 
Castle  Point  Station 
Hoboken  NJ  07030 

Vice-President,  Academic  Affairs 
Univ  of  Tennessee  at  Knoxville 
Knoxville  TN  37916 

Vice-President,  Academic  Affairs 
Univ  of  Tennessee 
Tullahoma  TN  37388 

Vice-President,  Academic  Affairs 
Univ  of  Texas  at  Austin 
Au  s t i n TX  7 8712 

Vice-President,  Academic  Affairs 
Texas  State  Technical  Institute 
Waco  TX  76705 


Vice-Pres ident  , Ac  ademi  c 
Univ  of  Texas 
Galveston  TX  77550 
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Univ  of  Toledo 
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Tri-State  Un i v 
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Tulane  Univ 

Belle  Chasse  LA  70037 

Vice-President , Ac ademi  c 
Un i V of  Tu Isa  . 
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Vice-President , Ac ademi c 
Univ  of  Vermont 
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Vice-President,  Academic 
Univ  of  Virginia 
Charlottesvl  VA  22901 

Vice-President,  Ac  a d emi  c 
Washington  Univ 
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Vice-President , Ac  ademi  c 
Wayne  State  Univ 
Detroit  MI  48202 


Vice-President,  Acad  emi  c 
West  Virginia  Univ 
Morgantown  WV  26506 

Vice-President , Ac  ad emi  c 
Tufts  Univ 
Medford  MA  02155 

Vice-President , Ac ademi  c 

Tulane  Univ 

New  Orleans  LA  70118 

V i c e-Pr e s i dent , Ac  ad emi  c 
Vanderbilt  Univ 
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Vice-President,  Academic  Affairs 
Virginia  Polytechnic  Institute 
& State  University 
Blacksburg  VA  24061 

Vice-President,  Academic  Affairs 
Washington  State  Univ 
Pullman  WA  99164 

Vice-President,  Academic  Affairs 
Univ  of  Washington 
Seattle  WA  98195 

Vice-President,  Academic  Affairs 
Webb  Inst,  of  Naval  Architecture 
Glenn  Cove  NY  11542 


Vice-President,  Academic  Affairs 
Western  Michigan  Univ 
Kalamazoo  MI  4 9 001 

Vice-President,  Academic  Affairs 
Western  Washington  Univ 
Bell ingham  WA  98225 

Vice-President,  Academic  Affairs 
Univ  of  Wi  scons  in-Platt evi 1 le 
Plattevil le  Wl  53818 


Vice-President,  Academic  Affairs 
Univ  of  Wisconsin 
College  of  Engineering 
Madison  Wl  53706 

Vice-President,  Academic  Affairs 
Wr  ight  State  Un i v 
Dayton  OH  45429 

Vice-President,  Academic  Affairs 
Yale  Univ 

New  Haven  CT  06520 

Vice-President,  Academic  Affairs 
Wichita  State  Univ 
Wichita  KS  67208 


Vice-President,  Academic  Affairs 
Univ  of  Wisconsin/Milwaukee 
Milwaukee  WI  53201 


Vice-President,  Academic  Affairs 
Worcester  Polytechnic  Institute 
Wo  r c e s t e r MA  01609 


Vice-President,  Academic  Affairs 
Univ  of  Wyoming 
Laramie  WY  82071 

Dean, College  of  Physical  Science 
Univ  of  Alaska 
Fairbanks  AK  99701 

Dean, College  of  Physical  Science 
Univ  of  Arizona 
Tucson  AZ  85721 

Dean, College  of  Physical  Science 
California  Inst,  of  Technology 
Pasadena  CA  91125 


Dean, College  of  Physical  Science 
Univ  of  Colorado 
Boulder  CO  80309 

Dean, College  of  Physical  Science 
Da  r tmo  uth  College 
Hanover  NH  03755 

Dean, College  of  Physical  Science 
Embry  Riddle  Aeronautical  Univ 
Daytona  Bch  FL  32014 

Dean, College  of  Physical  Science 
Florida  Institute  of  Technology 
Me  1 b o u r n e FL  32901 


Dean, College  of  Physical  Science 
Univ  of  California 
Lawrence  Live  rmo  r e Lab 
Livermore  CA  94550 

Dean, College  of  Physical  Science 
Colorado  State  Univ 
Ft  Coll  ins  CO  80523 

Dean, College  of  Physical  Science 
Co  r ne 1 1 Un i v 
Ithaca  NY  14583 


Dean, College  of  Physical  Science 
Univ  of  Dayton 
Research  Institute 
Dayton  OH  45469 

Dean, College  of  Physical  Science 
Arizona  State  Univ 
Tempe  AZ  85257 

Dean, College  of  Physical  Science 
Univ  of  Arkansas 
Fayetteville  AR  72701 


Dean, College  of  Physical  Science 
Univ  of  California 
Lawrence  Berkeley  Lab 
Berkeley  CA  94720 

Dean, College  of  Physical  Science 
Univ  of  California 
Los  Alamos  National  Lab 
Los  Alamos  hM  87545 


Dean, College  of  Physical  Science 
Georgia  Institute  of  Technology 
Atlanta  GA  30332 

Dean, College  of  Physical  Science 
Johns  Hopkins  Univ 
Laurel  MD  20707 


Dean, College  of  Physical  Science 
Massachusetts  Inst,  of  Technolog 
Cambridge  MA  02139 

Dean, College  of  Physical  Science 
Univ  of  Michigan 
Ann  Arbor  MI  48109 
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Dean, College  of  Physical  Science 
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Univ  of  Alabama  Huntsville 
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Dean, College  of  Physical  Science 
Univ  of  Alabama 
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Dean, College  of  Physical  Science 
Univ  of  Arkansas 
Little  Rock  AR  72203 

Dean, College  of  Physical  Science 
Ausurn  Univ 
Auburn  AL  36849 


Dean, College  of  Physical  Science 
Univ  of  Pittsburgh 
Pittsburgh  PA  15260 

Dean, College  of  Physical  Science 
Purdue  Univ 
W Lafayette  IN  47907 


Dean, College  of  Physical  Science 
Austin  State  Univ 
Nacogdoches  TX  75961 

Dean, College  of  Physical  Science 
Br ande i s Un i v 
Waltham  02254 


Dean, College  of  Physical  Science 
Rockefeller  Univ 
New  York  NY  10021 

Dean, College  of  Physical  Science 
Univ  of  Southern  California 
Los  Angeles  CA  90007 

Dean, College  of  Physical  Science 

Texas  A^M  Univ 

Col  lege  Sta  TX  77843 

Dean, College  of  Physical  Science 

Univ  of  Utah 

Salt  Lake  Cy  UT  84112 

Dean, College  of  Physical  Science 
Southeastern  Oklahoma  State  Univ 
Durant  OK  74701 

Dean, College  of  Physical  Science 
Utah  State  Univ 
Logan  UT  84322 


Dean, College  of  Physical  Science 
Areospace  Technoogical  Inst 
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Dean, College  of  Physical  Science 
Univ  of  Alabama  in  Birmingham 
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Dean, College  of  Physical  Science 
A1 1 iance  Co  liege 
Cambrg  Spgs  PA  16403 

Dean, College  of  Physical  Science 
Augus  ta  College 
Augusta  GA  30910 

Dean, College  of  Physical  Science 
Bowling  Green  State  Univ 
Bowling  Green  OH  43403 

Dean, College  of  Physical  Science 
Brevard  Conmunity  College 
Melbourne  FL  32935 


Dean, College  of  Physical  Science 
Academy  of  Aeronautics 
Flushing  NY  11371 


Dean, College  of  Physical  Science 
Univ  of  Bridgeport 
Bridgeport  CT  06602 


Dean, College  of  Physical  Science 
Brown  Univ 
Providence  RI  02912 

Dean, College  of  Physical  Science 
California  State  Polytechnic  Uni 
Pomona  CA  91768 

Dean, College  of  Physical  Science 
Univ  of  California/Berkeley 
Berkeley  CA  94720 


Dean, College  of  Physical  Science 
Case  Western  Reserve  Univ 
Cleveland  OH  44106 

Dean, College  of  Physical  Science 
Univ  of  Chicago 
Chicago  IL  60637 

Dean, College  of  Physical  Science 
Univ  of  Cincinnati 
Cincinnati  OH  45221 


Dean, College  of  Physical  Science 
Univ  of  California/Riverside 
Riverside  C A 92521 

Dean, College  of  Physical  Science 
Univ  od  Ca 1 i f o r n i a /Sa n t a Barbara 
Santa  Barbara  C A 93106 


Dean, College  of  Physical  Science 
Cl  a r emont  Co  lieges 
Claremont  CA  91711 

Dean, College  of  Physical  Science 
Clems  on  Univ 
Clenson  SC  29631 


Dean, College  of  Physical  Science 
Carnegie  Mellon  Univ 
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Dean, College  of  Physical  Science 
Catholic  Univ  of  America 
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Dean, College  of  Physical  Science 
Brigham  Young  Univ 
Provo  UT  84602 


Dean, College  of  Physical  Science 
Colorado  School  of  Mines 
Golden  CO  80401 

Dean, College  of  Physical  Science 
Univ  of  Connecticut 
Storrs  CT  06268 

Dean, College  of  Physical  Science 
Univ  of  Detroit 
Detroit  MI  48221 


Dean, College  of  Physical  Science 
California  State  Coll  Stanislaus 
Turlock  CA  95380 


Dean, College  of  Physical  Science 
Duke  Univ 
Durham  NC  27706 


Dean, College  of  Physical  Science 
California  State  Univ  Fullerton 
Fullerton  CA  92634 

Dean, College  of  Physical  Science 
Univ  of  California/Davis 
Davis  CA  95616 

Dean, College  of  Physical  Science 
Univ  of  Ca 1 i f o rn i a /San  Francisco 
San  Francisco  CA  94143 

Dean, College  of  Physical  Science 
Univ  of  California 
Los  Angeles  CA  90024 


Dean, College  of  Physical  Science 
F W Energy  Applications  Inc 
Livingston  NJ  07039 

Dean, College  of  Physical  Science 
City  College  of  the  Univ.  of 
New  York 

New  York  NY  10031 

Dean, College  of  Physical  Science 
Clarkson  College  of  Technology 
Postdam  NY  13676 

Dean, College  of  Physical  Science 
Cleveland  State  Univ 
Cleveland  OH  44115 


Dean, College  of  Physical  Science 
Columbia  Univ 
New  York  NY  10027 

Dean, College  of  Physical  Science 
Univ  of  Delaware 
Newark  DE  19711 


Dean, College  of  Physical  Science 
George  Washington  Univ 
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Dean, College  of  Physical  Science 
Univ  of  Georgia 
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Drexel  Univ 
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Dean ,Co liege  of  Phy sical  Science 
Duque  sne  Univ 
Pittsburgh  PA  15219 

Dean, College  of  Physical  Science 
Florida  International  University 
Mi  ama  FL  3 3199 
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Hahnemann  Medical  Coll  & Hospita 
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Dean, College  of  Physical  Science 
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Dean, College  of  Physical  Science 
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Hofstra  Univ 
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Dean, College  of  Physical  Science 
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Dean, College  of  Physical  Science 
Howard  Univ 
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Univ  of  Idaho 
Mo  scow  ID  8 3843 
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Univ  of  111 inoi s 
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Indiana  Institute  of  Technology 
Ft  Wayne  IN  46803 
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I owa  State  Un i v 
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Kansas  State  Univ 
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Lehigh  Univ 
Bethlehem  PA  18015 
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Lock  Haven  State  Univ 
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Baton  Rouge  LA  70803 
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Dean, College  of  Physical  Science 
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Dean, College  of  Physical  Science 
Michigan  State  Univ 
East  Lansing  Ml  48824 
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Univ  of  Michigan 
Ann  Arbor  MI  48109 
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Univ  of  Mississippi 
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Dean, College  of  Physical  Science 
Univ  of  Missouri 
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Dean, College  of  Physical  Science 
Univ  of  Nebraska 
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New  Jersey  Inst,  of  Technology 
Newark  NJ  07102 

Dean, College  of  Physical  Science 
New  Mexico  State  Univ 
Las  Cruses  hM  88003 

Dean, College  of  Physical  Science 
New  York  State  Coll  of  Ceramics 
Alfred  NY  14802 

Dean, College  of  Physical  Science 
New  York  Univ 
New  York  NY  10012 

Dean, College  of  Physical  Science 
U of  North  Carolina  at  Charlotte 
Charlotte  NC  28223 

Dean, College  of  Physical  Science 
North  Carolina  State  Univ 
Raleigh  NC  27650 

Dean, College  of  Physical  Science 
Montana  State  Univ 
Bozeman  MT  59717 

Dean, College  of  Physical  Science 
Univ  of  Nevada 
Reno  NV  89557 

Dean, College  of  Physical  Science 
New  Mexico  Institute  of  Mining 
and  Techno  logy 
Socorro  NVl  87801 


Dean, College  of  Physical  Science 
New  York  Univ 
Courant  Institute 
New  York  NY  10012 

Dean, College  of  Physical  Science 
Norfolk  State  Univ 
Norfolk  VA  23501 


Dean, College  of  Physical  Science 
U of  North  Carolina  at  Wilmingto 
Wilmington  NC  28401 


Dean, College  of  Physical  Science 
Univ  of  North  Carolina 
Chapel  Hill  NC  27515 

Dean, College  of  Physical  Science 
Northeast  Louisiana  Univ 
Moroe  LA  71203 

Dean, College  of  Physical  Science 
Northeastern  Univ 
Boston  M\  02115 


Dean, College  of  Physical  Science 
Univ  of  Northern  Colorado 
Greeley  CO  80639 


Dean, College  of  Physical  Science 
Northrop  Univ 
Inglewood  CA  90306 

Dean, College  of  Physical  Science 

Norwich  Univ 

North  Field  VT  05663 


Dean, College  of  Physical  Science 
Ohio  Northern  Univ 
Ada  OH  45810 


Dean, College  of  Physical  Science 
Univ  of  Oklahoma 
Norman  OK  73019 


Dean, College  of  Physical  Science 
Univ  of  Oklahoma 
Oklahoma  City  OK  73190 


Dean, College  of  Physical  Science 
Univ  of  New  Orleans 
New  Orleans  LA  70148 


Dean, College  of  Physical  Science 
Northeast  Missouri  State  Univ 
Kirksville  M3  63501 


Dean, Co  liege  of  Phys ical  Science 
Northern  Arizona  Univ 
Flagstaff  AZ  86011 

Dean, College  of  Physical  Science 
Northern  Illinois  Univ 
Dekalb  IL  60115 


Dean, College  of  Physical  Science 
Rochester  Institute  of  Technolog 
Rochester  NY  14623 

Dean, College  of  Physical  Science 
Rose-Hulman  Inst  of  Technology 
Terre  Haute  IN  47803 


Dean, College  of  Physical  Science 
Northwestern  Univ 
Evanston  IL  60201 


Dean, College  of  Physical  Science 
Palomar  Conxnunity  College 
San  Marcos  CA  92069 


Dean, College  of  Physical  Science 
Univ  of  Notre  Dame 
Notre  Dame  IN  46556 

Dean, College  of  Physical  Science 
Oh i o State  Un i v 
Columbus  OH  43210 

Dean, College  of  Physical  Science 
Oklahoma  State  Univ 
St  i 1 Iwater  OK  74078 

Dean, College  of  Physical  Science 
Oregon  Health  Sciences  Univ 
Portland  OR  97207 


Dean, College  of  Physical  Science 
Oregon  State  Univ 
Corvallis  OR  97331 

Dean, College  of  Physical  Science 
Pennsylvania  State  Univ 
Hershey  PA  17033 

Dean, College  of  Physical  Science 
Pennsylvania  State  Univ 
Univ  Park  PA  16802 

Dean, College  of  Physical  Science 
Ph i 1 1 i p s Un i v 
Enid  OK  73702 


Dean, College  of  Physical  Science 
Portland  State  Univ 
Portland  OR  97207 


Dean, College  of  Physical  Science 
Rensselaer  Polytechnic  Institute 
Troy  NY  12181 


Dean, College  of  Physical  Science 
Pennsylvania  State  Univ 
Capi  tol  Campus 
Middletown  PA  17057 

Dean, College  of  Physical  Science 
Univ  of  Pennsylvania 
Philadelphia  PA  19104 

Dean, College  of  Physical  Science 
Polytechnic  Institute  of  New  Yor 
Farmingdale  NY  11735 

Dean, College  of  Physical  Science 
Providence  College 
Providence  RI  02918 

Dean, College  of  Physical  Science 
Univ  of  Rhode  Island 
Kingston  RI  02881 

Dean, College  of  Physical  Science 
Un  i V of  Roche  s t e r 
Rochester  NY  14627 

Dean, College  of  Physical  Science 
Rutgers  Univ 
Pi  scat  away  NJ  08  854 

Dean, College  of  Physical  Science 
Saint  Louis  Univ 
Cahokia  IL  62206 

Dean, College  of  Physical  Science 
San  Diego  State  Univ 
San  Diego  CA  92182 

Dean, College  of  Physical  Science 
Univ  of  Santa  Clara 
Santa  Clara  CA  95053 


Dean, College  of  Physical  Science 
Univ  of  South  Carolina 
Columbia  SC  29208 

Dean, College  of  Physical  Science 
Univ  of  South  Dakota 
Vermi  1 1 ion  SD  57069 

Dean, College  of  Physical  Science 
Southern  Illinois  Univ 
Carbondale  IL  62901 

Dean, College  of  Physical  Science 
St  Vincent  College 
Latrobe  PA  15650 


Dean, College  of  Physical  Science 
State  Univ  of  New  York  at  Buffal 
Amherst  NY  14260 

Dean, College  of  Physical  Science 
State  Univ.  System  of  Florida 
Cpe  Canaveral  FL  32920 

Dean, College  of  Physical  Science 
Syracuse  Uni  vers i ty 
Syracuse  NY  13210 

Dean, College  of  Physical  Science 
Tennessee  Technological  Univ 
Cookeville  TN  38505 


Dean, College  of  Physical  Science 
State  Univ  of  New  York 
B i nghamt on  NY  13901 

Dean, College  of  Physical  Science 
Saint  Louis  Univ 
St  Louis  M)  63108 


Dean, College  of  Physical  Science 
Univ  of  Texas  at  Arlington 
Arlington  TX  76019 

Dean, College  of  Physical  Science 
Texas  Christian  Univ 
Fort  Worth  TX  76129 


Dean, College  of  Physical  Science 
San  Jose  State  Univ 
San  Jose  CA  95192 

Dean, College  of  Physical  Science 
Slippery  Rock  State  College 
Slippery  Rock  PA  16057 

Dean, College  of  Physical  Science 
South  Dakota  Sch  of  Mines  & Tech 
Rapid  City  SD  57701 

Dean, College  of  Physical  Science 
Univ  of  Southern  California 
Tucson  AZ  85713 

Dean, College  of  Physical  Science 
Southern  Methodist  Univ 
Dallas  TX  75275 

De an ,Co liege  of  Phy s ical  Science 
Stanford  Univ 
Stanford  CA  94305 

Dean, College  of  Physical  Science 
State  Univ  of  New  York  at  Albany 
Albany  NY  12222 


Dean, College  of  Physical  Science 
Texas  Tech  Univ 
Lubbock  TX  79409 

Dean, College  of  Physical  Science 

Univ  of  Texas 

San  Antonio  TX  78284 

Dean, College  of  Physical  Science 
State  University  of  New  York 
At  Stony  Brook 
Stony  Brook  NY  11794 

Dean, College  of  Physical  Science 
Stevens  Institute  of  Technology 
Castle  Point  Station 
Hoboken  NJ  07030 

Dean, College  of  Physical  Science 
Univ  of  Tennessee  at  Knoxville 
Knoxvi lie  TN  37916 

Dean, College  of  Physical  Science 
Univ  of  Tennessee 
Tullahoma  TN  37388 

Dean, College  of  Physical  Science 
Univ  of  Texas  at  Austin 
Aus  tin  TX  7 8712 


Dean, College  of  Physical  Science 
Texas  State  Technical  Institute 
Waco  TX  76705 


Dean, College  of  Physical  Science 
Vande  r b i It  Uni v 
Nashvi 1 1 e TN  37203 


Dean, College  of  Physical 
Univ  of  Texas 
Galveston  TX  77550 


Dean, College  of  Physical 
Univ  of  Toledo 
Toledo  OH  43606 

Dean, College  of  Physical 
Tri“State  Un i v 
Angola  IN  46703 

Dean, College  of  Physical 

Tulane  Univ 

Belle  Chasse  LA  70037 

Dean, College  of  Physical 
Univ  of  Tulsa 
Tulsa  OK  74104 


Dean, College  of  Physical 
Univ  of  Vermont 
Burlington  VT  05405 


Dean, College  of  Physical 
Univ  of  Virginia 
Charlottesvl  VA  22901 


Dean, College  of  Physical 
Washington  Univ 
St  Louis  MD  63130 


Dean, College  of  Physical 
Wayne  State  Univ 
Detroit  MI  48202 


Dean, College  of  Physical 
We  st  Virginia  Un i v 
Morgantown  WV  26506 

Dean, College  of  Physical 
Tuf  t s Un i V 
Medford  MA  02155 


Dean, College  of  Physical 

Tulane  Univ 

New  Orleans  LA  70118 
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Dean, College  of  Physical  Science 
Virginia  Polytechnic  Institute 
& State  University 
Blacksburg  VA  24061 

Dean, College  of  Physical  Science 
Washington  State  Univ 
Pullman  WA  99164 

Dean, College  of  Physical  Science 
Univ  of  Washington 
Seattle  WA  98195 

Dean, College  of  Physical  Science 
Webb  Inst,  of  Naval  Architecture 
Glenn  Cove  NY  11542 

Dean, College  of  Physical  Science 
Western  Michigan  Univ 
Kalamazoo  MI  49001 

Dean, College  of  Physical  Science 
Western  Washington  Univ 
Bell  ingham  WA  9 8 225 

Dean, College  of  Physical  Science 
Univ  of  Wi  s cons i n-P 1 a 1 1 e v i 1 1 e 
Plat tevi 1 le  WI  53818 

Dean, College  of  Physical  Science 
Univ  of  Wisconsin 
College  of  Engineering 
Madison  WI  53706 

Dean, College  of  Physical  Science 
Wr  ight  State  Un i v 
Dayton  OH  45429 

Dean, College  of  Physical  Science 

Yale  Univ 

New  Haven  CT  06520 

Dean, College  of  Physical  Science 
Wichita  State  Univ 
Wichita  KS  67208 

Dean, College  of  Physical  Science 
Univ  of  Wisconsin/Milwaukee 
Milwaukee  WI  53201 


Dean, College  of  Physical  Science 
Worcester  Polytechnic  Institute 
Wo  r c e s t e r M\  01609 

Dean, College  of  Physical  Science 
Univ  of  Wyoming 
Laramie  WY  82071 

Dean,  College  of  Engineering 
Univ  of  Alaska 
Fairbanks  AK  99701 

Dean,  College  of  Engineering 
Univ  of  Arizona 
Tucson  AZ  85721 

Dean,  College  of  Engineering 
California  Inst,  of  Technology 
Pasadena  CA  91125 

Dean,  College  of  Engineering 
Univ  of  California 
Lawrence  Livermore  Lab 
Livermore  CA  94550 

Dean,  College  of  Engineering 
Colorado  State  Univ 
Ft  Collins  CO  80523 

Dean,  College  of  Engineering 
Come  1 1 Univ 
Ithaca  NY  14583 

Dean,  College  of  Engineering 
Univ  of  Dayton 
Research  Institute 
Dayton  OH  45469 

Dean,  College  of  Engineering 
Arizona  State  Univ 
Tempe  AZ  85257 

Dean,  College  of  Engineering 
Univ  of  Arkansas 
Fayetteville  AR  72701 

Dean,  College  of  Engineering 
Univ  of  California 
Lawrence  Berkeley  Lab 
Berkeley  CA  94720 


Dean,  College  of  Engineering 
Univ  of  California 
Los  Alamos  National  Lab 
Los  Alamos  NVl  87545 

Dean,  College  of  Engineering 
Univ  of  Colorado 
Boulder  CO  80309 

Dean,  College  of  Engineering 
Dartmouth  College 
Hanover  NH  03755 

Dean,  College  of  Engineering 
Embry  Riddle  Aeronautical  Univ 
Daytona  Bch  FL  32014 

Dean,  College  of  Engineering 
Florida  Institute  of  Technology 
Melbourne  FL  32901 

Dean,  College  of  Engineering 
Georgia  Institute  of  Technology 
Atlanta  GA  30332 

Dean,  College  of  Engineering 
Johns  Hopkins  Univ 
Laurel  MD  20707 

Dean,  College  of  Engineering 
Massachusetts  Inst,  of  Technolog 
Cambridge  MA  02139 

Dean,  College  of  Engineering 
Univ  of  Michigan 
Ann  Arbor  MI  48109 

Dean,  College  of  Engineering 
Univ  of  Mi  s sour i-Ro 1 1 a 
Rolla  M)  65401 

Dean,  College  of  Engineering 
Pennsylvania  State  Univ 
State  Colleege  PA  16801 

Dean,  College  of  Engineering 
Princeton  Univ 
Princeton  NJ  08544 

Dean,  College  of  Engineering 
Univ  of  Florida 
Gainesville  FL  32611 


Dean,  College  of  Engineering 

Un i V o f I owa 

Iowa  City  lA  52242 

Dean,  College  of  Engineering 
Univ  of  Kansas 
Lawrence  KS  66045 

Dean,  College  of  Engineering 
Massachusetts  Inst,  of  Technolog 
Lexington  MA.  02173 

Dean,  College  of  Engineering 
Univ  of  Minnesota 
Minneapolis  MN  55455 

Dean,  College  of  Engineering 
Univ  of  New  Mexico 
Albuquerque  NVl  87131 

Dean,  College  of  Engineering 
Univ  of  Pittsburgh 
Pittsburgh  PA  15260 

Dean,  College  of  Engineering 
Purdue  Univ 
W Lafayette  IN  47907 

Dean,  College  of  Engineering 
Rockefeller  Univ 
New  York  NY  10021 

Dean , Co  liege  of  Eng i ne e r i ng 
Univ  of  Southern  California 
Los  Angeles  CA  90007 

Dean,  College  of  Engineering 
Texas  A<SM  Univ 
College  Sta  TX  77843 

Dean,  College  of  Engineering 

Univ  of  Utah 

Salt  Lake  Cy  UT  84112 

Dean,  College  of  Engineering 
Southeastern  Ok 1 ahoma  State  Un i v 
Durant  OK  74701 

Dean,  College  of  Engineering 
Utah  State  Univ 
Logan  UT  84322 


Dean,  College  of  Engineering 
Academy  of  Aeronautics 
Flushing  NY  11371 

Dean,  College  of  Engineering 
Univ  of  Alabama  Huntsville 
Huntsville  AL  35899 

Dean,  College  of  Engineering 
Univ  of  Alabama 
University  AL  35486 

Dean,  College  of  Engineering 
Univ  of  Arkansas 
Little  Rock  AR  72203 

Dean,  College  of  Engineering 
Ausurn  Univ 
Auburn  AL  36849 

Dean,  College  of  Engineering 
Austin  State  Univ 
Nacogdoches  TX  75961 

Dean,  College  of  Engineering 
Brande i s Univ 
Waltham  MA  02254 

Dean,  College  of  Engineering 
Areospace  Technoogical  Inst 
Independence  MD  64050 

Dean,  College  of  Engineering 
Univ  of  Alabama  in  Birmingham 
Birmingham  AL  35294 

Dean,  College  of  Engineering 
Alliance  College 
Cambrg  Spgs  PA  16403 

Dean,  College  of  Engineering 
Augus  ta  Coll ege 
Augusta  GA  30910 

Dean,  College  of  Engineering 
Bowling  Green  State  Univ 
Bowling  Green  OH  43403 

Dean,  College  of  Engineering 
Brevard  Conmunity  College 
Melbourne  FL  32935 


Dean,  College  of  Engineering 
Univ  of  Bridgeport 
Bridgeport  CT  06602 

Dean,  College  of  Engineering 
Brown  Univ 
Providence  RI  02912 

Dean,  College  of  Engineering 
California  State  Polytechnic  Uni 
Pomona  CA  91768 

Dean,  College  of  Engineering 
Univ  of  California/Berkeley 
Berkeley  CA  94720 

Dean,  College  of  Engineering 
Univ  of  Ca 1 i f o rn i a /Ri ve r s i de 
Riverside  CA  92521 

Dean,  College  of  Engineering 
Univ  od  Ca 1 i f o r n i a / San t a Barbara 
Santa  Barbara  C A 93106 

Dean,  College  of  Engineering 
Carnegie  Mellon  Univ 
Pittsburgh  PA  15213 

Dean,  College  of  Engineering 
Catholic  Univ  of  America 
Washington  DC  20064 

Dean,  College  of  Engineering 
Brigh^Lm  Young  Univ 
Provo  UT  84602 

Dean,  College  of  Eng ineering 
California  State  Coll  Stanislaus 
Turlock  CA  95380 

Dean,  College  of  Engineering 
California  State  Univ  Fullerton 
Fullerton  CA  92634 

Dean,  College  of  Engineering 
Univ  of  California/Davis 
Davis  CA  95616 

Dean,  College  of  Engineering 
Univ  of  Ca 1 i f orn i a /San  Francisco 
San  Francisco  CA  94143 


Dean,  College  of  Engineering 
Univ  of  California 
Los  Angeles  CA  90024 

Dean,  College  of  Engineering 
Case  Western  Reserve  Univ 
Cleveland  OH  44106 

Dean,  College  of  Engineering 
Univ  of  Chicago 
Chi cago  IL  60637 

Dean,  College  of  Engineering 
Univ  of  Cincinnati 
Cincinnati  OH  45221 

Dean,  College  of  Engineering 
Cl aremont  Colleges 
C 1 a r emo  n t CA  91711 

Dean,  College  of  Engineering 
Clems  on  Univ 
Clenson  SC  29631 

Dean,  College  of  Engineering 
Colorado  School  of  Mines 
Golden  CO  80401 

Dean,  College  of  Engineering 
Univ  of  Connecticut 
Storrs  CT  06268 

Dean,  College  of  Engineering 
Univ  of  Detroit 
Detroit  MI  48221 

Dean,  College  of  Engineering 
Duke  Univ 
Durham  NC  27706 

Dean,  College  of  Engineering 
F W Energy  Applications  Inc 
Livingston  NJ  07039 

Dean,  College  of  Engineering 
City  College  of  the  Univ.  of 
New  York 

New  York  NY  10031 

Dean,  College  of  Engineering 
Clarkson  College  of  Technology 
Postdam  NY  13676 


Dean,  College  of  Engineering 
Cleveland  State  Univ 
Cleveland  OH  44115 

Dean,  College  of  Engineering 
Columbia  Univ 
New  York  NY  10027 

Dean,  College  of  Engineering 
Un i v of  Del awa r e 
Newark  DE  19711 

Dean,  College  of  Engineering 
Drexel  Univ 
Philadelphia  PA  19104 

Dean,  College  of  Engineering 
Duquesne  Univ 
Pittsburgh  PA  15219 

Dean,  College  of  Engineering 
Florida  International  University 
Mi  ama  FL  33199 

Dean,  College  of  Engineering 
Florida  State  Univ 
Tallahassee  FL  32306 

Dean,  College  of  Engineering 
George  Washington  Univ 
Washington  DC  20052 

Dean,  College  of  Engineering 
Gonzaga  Univ 
Spokane  WA  99258 

Dean,  College  of  Engineering 
Hartford  Graduate  Center 
Hartford  CT  06120 

Dean,  College  of  Engineering 
Univ  of  Hawa  i i 
Honolulu  HI  96822 

Dean,  College  of  Engineering 
Hof  s t ra  Univ 
Hempstead  NY  11550 

Dean,  College  of  Engineering 
Houghton  College 
Houghton  NY  14744 


Dean,  College  of  Engineering 
Howard  Univ 
Washington  DC  20059 

Dean,  College  of  Engineering 
George  Washington  Univ 
Washington  DC  20036 

Dean,  College  of  Engineering 
Univ  of  Georgia 
Athens  GA  30602 

Dean,  College  of  Engineering 
Hahnemann  Medical  Coll  & Hospita 
Philadelphia  PA  19102 

Dean,  College  of  Engineering 
Havard  Univ 
Cambridge  02138 

Dean,  College  of  Engineering 
Herbert  Lehman  College 
Bronx  NY  10468 

Dean,  College  of  Engineering 
Holy  Cross  College 
Wo  r c e s t e r MA.  01610 

Dean,  College  of  Engineering 
Univ  of  Houston 
Houston  TX  77004 

Dean,  College  of  Engineering 
Idaho  State  Univ 
Pocatello  ID  83209 

Dean,  College  of  Engineering 
Univ  of  Idaho 
Mo  scow  ID  83843 

Dean,  College  of  Engineering 
Univ  of  111 ino i s 
a t Ch icago  Circle 
Ch icago  IL  60680 

Dean,  College  of  Engineering 
Indiana  Institute  of  Technology 
Ft  Wayne  IN  46803 

Dean,  College  of  Engineering 
I owa  State  Un i v 
Ames  I A 50011 


Dean,  College  of  Engineering 
Kansas  State  Univ 
Manhattan  KS  66506 

Dean,  College  of  Engineering 
Lehigh  Univ 
Bethlehem  PA  18015 

Dean,  College  of  Engineering 
Lock  Haven  State  Univ 
Lock  Haven  PA  17745 

Dean,  College  of  Engineering 
Louisiana  State  Univ 
Baton  Rouge  LA  70803 

Dean,  College  of  Engineering 
Illinois  Institute  of  Technology 
Ch icago  IL  60616 

Dean,  College  of  Engineering 
Univ  of  Illinois 
Urbana  IL  61801 

Dean , Co  liege  of  Eng i ne e r i ng 
Institute  of  Sto rm  Research 
Houston  TX  77006 

Dean,  College  of  Engineering 
Johns  Hopkins  Univ 
Baltimore  M)  21218 

Dean , Co  liege  of  Eng i ne  e r i ng 
Univ  of  Kentucky 
Lexington  KY  40506 

Dean,  College  of  Engineering 
Letorneau  Co  liege 
Longview  TX  75607 

Dean,  College  of  Engineering 
Long  Island  Univ  of  Brookville 
Greenville  NY  11548 

% 

Dean,  College  of  Engineering 
Louisiana  Tech  Univ 
Ruston  LA  71272 

1 

Dean,  College  of  Engineering 
Univ  of  Louisville 
Louisville  KY  40292 


Dean , Co  liege  of  Eng i ne e r i ng 
Manhattan  College 
Bronx  NY  10471 

Dean,  College  of  Engineering 
Univ  of  Maryland 
College  Park  MD  20742 

Dean,  College  of  Engineering 
Medical  College  of  Wisconsin 
Milwaukee  WI  53226 

Dean,  College  of  Engineering 
Memp his  State  Univ 
Memphis  IN  38152 

Dean,  College  of  Engineering 

Univ  of  Miami 

Coral  Gables  FL  33124 

Dean,  College  of  Engineering 
Michigan  Technological  Univ 
Houghton  MI  49931 

Dean,  College  of  Engineering 
Mississippi  State  Univ 
State  College  MS  39762 

Dean,  College  of  Engineering 
Univ  of  Maine  at  Orono 
Orono  ME  04469 

Dean,  College  of  Engineering 
Univ  of  Maryland 
Baltimore  MD  21201 

Dean,  College  of  Engineering 
Univ  of  Massachusetts 
Anherst  MA  01003 

Dean,  College  of  Engineering 
Meharry  Medical  College 
Nashvi 1 1 e TN  37208 

Dean,  College  of  Engineering 
Miami  Univ 
Oxford  OH  45056 

Dean,  College  of  Engineering 
Michigan  State  Univ 
East  Lansing  MI  48824 


Dean,  College  of  Engineering 
Univ  of  Michigan 
Ann  Arbor  MI  48109 

Dean,  College  of  Engineering 
Univ  of  Mississippi 
University  MS  38677 

Dean,  College  of  Engineering 
Univ  of  Missouri 
Columbia  M3  65211 

Dean,  College  of  Engineering 
Univ  of  Nebraska 
Lincoln  NE  68S88 

Dean,  College  of  Engineering 
New  Jersey  Inst,  of  Technology 
Newark  NJ  07102 

Dean,  College  of  Engineering 
New  Mexico  State  Univ 
Las  Cruses  >M  88003 

Dean,  College  of  Engineering 
New  York  State  Coll  of  Ceramics 
Alfred  NY  14802 

Dean,  College  of  Engineering 
New  York  Univ 
New  York  NY  10012 

Dean,  College  of  Engineering 
U of  North  Carolina  at  Charlotte 
Charlotte  NC  28223 

Dean,  College  of  Engineering 
North  Carolina  State  Univ 
Raleigh  NC  27650 

Dean,  College  of  Engineering 
Montana  State  Univ 
Bozeman  MT  59717 

Dean,  College  of  Engineering 
Univ  of  Nevada 
Reno  NV  89557 

Dean,  College  of  Engineering 
New  Mexico  Institute  of  Mining 
and  Technology 
Socorro  hM  87801 


Dean,  College  of  Engineering 
Univ  of  New  Orleans 
New  Orleans  LA  70148 

Dean,  College  of  Engineering 
New  York  Univ 
Courant  Institute 
New  York  NY  10012 

Dean,  College  of  Engineering 
Norfolk  State  Univ 
Norfolk  VA  23501 

Dean,  College  of  Engineering 
U of  North  Carolina  at  Wilmingto 
Wilmington  NC  28401 

Dean,  College  of  Engineering 
Univ  of  North  Carolina 
Chapel  Hill  NC  27515 

Dean,  College  of  Engineering 
Northeast  Louisiana  Univ 
Moroe  LA  71203 

Dean,  College  of  Engineering 
Northeastern  Univ 
Boston  MA.  02115 

Dean,  College  of  Engineering 
Univ  of  Northern  Colorado 
Greeley  CO  80639 

Dean,  College  of  Engineering 
Northrop  Univ 
Inglewood  CA  90306 

Dean,  College  of  Engineering 

Norwich  Univ 

North  Field  VT  05663 

Dean,  College  of  Engineering 
Ohio  Northern  Univ 
Ada  OH  45810 

Dean,  College  of  Engineering 
Univ  of  Oklahoma 
Norman  OK  73019 

Dean,  College  of  Engineering 
Univ  of  Oklahoma 
Oklahoma  City  OK  73190 


Dean,  College  of  Engineering 
Northeast  Missouri  State  Univ 
Kirksville  M)  63501 

Dean,  Co  liege  of  Eng ineering 
Northern  Arizona  Univ 
Flagstaff  AZ  86011 

Dean,  College  of  Engineering 
Northern  Illinois  Univ 
Dekalb  IL  60115 

Dean,  College  of  Engineering 
Northwestern  Univ 
Evanston  IL  60201 

Dean,  College  of  Engineering 
Univ  of  Notre  Dame 
Notre  Dame  IN  46556 

Dean,  College  of  Engineering 
Oh i o State  Un i v 
Columbus  OH  43210 

Dean , Co  liege  of  Eng ineering 
Ok  1 a h oma  State  Un i v 
Stillwater  OK  74078 

Dean,  College  of  Engineering 
Oregon  Health  Sciences  Univ 
Portland  OR  97207 

Dean,  College  of  Engineering 
Oregon  State  Univ 
Corvallis  OR  97331 

Dean,  College  of  Engineering 
Pennsylvania  State  Univ 
Hershey  PA  17033 

Dean,  College  of  Engineering 
Pennsylvania  State  Univ 
Univ  Park  PA  16802 

Dean,  College  of  Engineering 
Phi  1 1 ips  Univ 
Enid  OK  73702 

Dean,  College  of  Engineering 
Portland  State  Univ 
Portland  OR  97207 


Dean,  College  of  Engineering 
Rensselaer  Polytechnic  Institute 
Troy  NY  12181 

Dean , Co  liege  of  Engineering 
Rochester  Institute  of  Techno  log 
Rochester  NY  14623 

Dean,  College  of  Engineering 
Rose-Hulman  Inst  of  Technology 
Terre  Haute  IN  47803 

Dean,  College  of  Engineering 
Pa  1 omar  Comnun i ty  College 
San  Marcos  CA  92069 

Dean,  College  of  Engineering 
Pennsylvania  State  Univ 
Cap i t o 1 Campus 
Middleto'vn  PA  17057 

Dean,  College  of  Engineering 
Univ  of  Pennsylvania 
Philadelphia  PA  19104 

Dean , Co  liege  of  Engineering 
Polytechnic  Institute  of  New  Yor 
Farmingdale  NY  11735 

Dean,  College  of  Engineering 
Providence  College 
Providence  RI  02918 

Dean,  College  of  Engineering 
Univ  of  Rhode  Island 
Kingston  RI  02881 

Dean,  College  of  Engineering 
Univ  of  Rochester 
Rochester  NY  14627 

Dean,  College  of  Engineering 
Rutgers  Univ 
Pi  scat  away  NJ  08  854 

Dean,  College  of  Engineering 
Saint  Louis  Univ 
Cahokia  IL  62206 

Dean,  College  of  Engineering 
San  Diego  State  Univ 
San  Diego  CA  92182 


Dean,  College  of  Engineering 
Univ  of  Santa  Clara 
Santa  Clara  CA  95053 

Dean,  College  of  Engineering 
Univ  of  South  Carolina 
Columbia  SC  29208 

Dean,  College  of  Engineering 
Univ  of  South  Dakota 
Vermillion  SD  57069 

Dean,  College  of  Engineering 
Southern  Illinois  Univ 
Carbondale  IL  62901 

Dean,  College  of  Engineering 
St  Vincent  College 
Latrobe  PA  15650 

Dean,  College  of  Engineering 
State  Univ  of  New  York 
Binghamton  NY  13901 

Dean,  College  of  Engineering 
Saint  Louis  Univ 
St  Louis  MO  63108 

Dean,  College  of  Engineering 
San  Jose  State  Univ 
San  Jose  CA  95192 

Dean,  College  of  Engineering 
Slippery  Rock  State  College 
Slippery  Rock  PA  16057 

Dean,  College  of  Engineering 
South  Dakota  Sch  of  Mines  & Tech 
Rapid  City  SD  57701 

Dean,  College  of  Engineering 
Univ  of  Southern  California 
Tucson  AZ  85T13 

Dean,  College  of  Engineering 
Southern  Methodist  Univ 
Dallas  TX  75275 

Dean,  College  of  Engineering 
Stanford  Univ 
Stanford  CA  94305 


Dean,  College  of  Engineering 
State  Univ  of  New  York  at  Albany 
Albany  NY  12222 

Dean,  College  of  Engineering 
State  Univ  of  New  York  at  Buffal 
Amherst  NY  14260 

Dean,  College  of  Engineering 
State  Univ.  System  of  Florida 
Cpe  Canaveral  FL  32920 

Dean,  College  of  Engineering 
Syracuse  Uni  vers i ty 
Syracuse  NY  13210 

Dean,  College  of  Engineering 
Tennessee  Technological  Univ 
Cookevi 1 1 e TN  38505 

Dean,  College  of  Engineering 
Univ  of  Texas  at  Arlington 
Arlington  TX  76019 

Dean,  College  of  Engineering 
Texas  Christian  Univ 
Fort  Worth  TX  76129 

Dean,  College  of  Engineering 
Texas  Tech  Univ 
Lubbock  TX  79409 

Dean,  College  of  Engineering 

Univ  of  Texas 

San  Antonio  TX  78284 

Dean,  College  of  Engineering 
State  University  of  New  York 
At  Stony  Brook 
Stony  Brook  NY  11794 

Dean,  College  of  Engineering 
Stevens  Institute  of  Technology 
Castle  Point  Station 
Hoboken  NJ  07030 

Dean,  College  of  Engineering 
Univ  of  Tennessee  at  Knoxville 
Knoxville  TN  37916 

Dean,  College  of  Engineering 
Univ  of  Tennessee 
Tullahoma  TN  37388 


Dean,  College  of  Engineering 
Univ  of  Texas  at  Austin 
Austin  TX  78712 

Dean,  College  of  Engineering 
Texas  State  Technical  Institute 
Waco  TX  76705 

Dean,  College  of  Engineering 
Univ  of  Texas 
Galveston  TX  77550 

Dean,  College  of  Engineering 
Univ  of  Toledo 
Toledo  OH  43606 

Dean,  College  of  Engineering 
Tri-State  Univ 
Angola  IN  46703 

Dean,  College  of  Engineering 

Tu  1 ane  Un i v 

Belle  Chasse  LA  70037 

Dean,  College  of  Engineering 
Un i V of  Tu Isa 
Tul sa  OK  74104 

Dean,  College  of  Engineering 
Univ  of  Vermont 
Burlington  VT  05405 

Dean,  College  of  Engineering 
Univ  of  Virginia 
Charlottesvl  VA  22901 

Dean,  College  of  Engineering 
Washington  Univ 
St  Louis  MD  63130 

Dean,  College  of  Engineering 
Wayne  State  Univ 
Detroit  MI  48202 

Dean,  College  of  Engineering 
West  Virginia  Univ 
Morgantown  WV  26506 

Dean,  College  of  Engineering 
Tu  f t s Un i V 
Medford  MA  02155 


Dean,  College  of  Engineering 

Tul ane  Univ 

New  Orleans  LA  70118 

Dean,  College  of  Engineering 
Vanderbilt  Univ 
Nashville  TN  37203 

Dean,  College  of  Engineering 
Virginia  Polytechnic  Institute 
& State  University 
Blacksburg  VA  24061 

Dean,  College  of  Engineering 
Washington  State  Univ 
Pullman  WA  99164 

Dean,  College  of  Engineering 
Univ  of  Washington 
Seattle  WA  98195 

Dean,  College  of  Engineering 
Webb  Inst,  of  Naval  Architecture 
Glenn  Cove  NY  11542 

Dean,  College  of  Engineering 
Western  Michigan  Univ 
Kalamazoo  MI  49001 

Dean,  College  of  Engineering 
Western  Washington  Univ 
BellinghamWA  98225 

Dean,  College  of  Engineering 
Univ  of  Wi  s cons i n— P 1 a 1 1 e V i 1 1 e 
Plattevi 1 le  WI  53818 

Dean,  College  of  Engineering 
Univ  of  Wisconsin 
College  of  Engineering 
Madison  WI  53706 

Dean,  College  of  Engineering 
Wr  ight  State  Univ 
Dayton  OH  45429 

Dean,  College  of  Engineering 
Yale  Univ 

New  Haven  CT  06520 

Dean,  College  of  Engineering 
Wichita  State  Univ 
Wichita  KS  67208 


Dean,  College  of  Engineering 
Univ  of  Wisconsin/Milwaukee 
Milwaukee  WI  53201 

Dean,  College  of  Engineering 
Worcester  Polytechnic  Institute 
Wo  r c e s t e r M\  01609 

Dean,  College  of  Engineering 
Univ  of  Wyoming 
Laramie  WY  82071 

Dean, College  of  Physical  Science 
U.  of  Southwestern  Louisiana 
Lafayette  LA  70504 

Vice-President,  Academic  Affairs 
Southern  Un iversity 
Baton  Rouge  LA  70813 

Dean,  College  of  Engineering 
U.  of  Southwestern  Louisiana 
Lafayette  LA  70504 

Dean, College  of  Physical  Science 
Southern  University 
Baton  Rouge  LA  70813 

Vice-President,  Academic  Affairs 
U.  of  Southwestern  Louisiana 
Lafayette  LA  70504 

Dean,  College  of  Engineering 
Southern  Un iversity 
Baton  Rouge  LA  70813 


ATTACHMENT  2.2 


NEEDS  ANALYSIS  PHASE: 
QUESTIONNAIRE  COVER  LETTER 

TO 


TARGETED  INSTITUTIONS 


National  Aeronautics  and 
Space  Administration 


Washington,  D.C. 


20546 


Reply  to  Attn  of: 


March  30,  1984 


Dear  Colleague: 

Pursuant  to  a research  and  development  contract  with  the 
National  Aeronautics  and  Space  Administration  (NASA),  the 
University  of  Southwestern  Louisiana  (USL)  and  Southern 
University  (SU)  are  jointly  addressing  the  needs  analysis, 
development,  pilot  administration,  and  evaluation  of  a set  of 
transportable,  university-level  courses  to  educate  science  and 
engineering  students  in  the  principles,  concepts,  and  effective 
use  of  computer-based,  scientific  and  technical  bibliographic 
information  storage  and  retrieval  systems. 


This  project  was  initiated  to  provide  a framework  whereby 
science  and  engineering  graduates  from  colleges  and  universities 
offering  such  courses  can  gain  the  experience,  skills,  and 
motivation  necessary  for  the  effective  use  of  the  types  of 
automated  research  support  systems  that  would  be  an  integral  part 
of  their  subsequent  R&D  working  environment. 


In  order  to  accomplish  this  objective,  these  courses  will  be 
designed  to  address  a non— compu t e r-prof e s s i ona 1 audience, 
specifically,  senior-level  science  and  engineering  undergraduate 
students,  with  the  intent  that  the  courses  ultimately  be  offered 
by  individual  Physical  Sciences  and  Engineering  Departments 
within  the  university;  to  address  both  state-of-the-art 
concepts,  principles,  and  capabilities  that  are  gene r a 1 i zab 1 e 
across  systems  as  well  as  specific,  pragmatic  techniques  for 
effectively  utilizing  existing  systems  and  data  bases;  and  to 
incorporate  extensive  hands-on  interactive  usage  by  students  with 
a number  of  large-scale  scientific  and  technical  information 
systems  and  data  bases,  such  as  the  NASA  REOON  system  and  its 
supported  data  bases. 


This  is  a multi-year  project  that,  in  addition  to  the 
initial  needs  analysis,  course  development,  pilot  administration 
and  evaluation  activities,  will  involve  the  conduct  of  regional 
and  on— site  seminars  for  interested  colleges  and  universities, 
course  material  dissemination,  assistance  in  relating  course 
material  to  existing  university  curricula,  institutional  and 
graduated  student  surveys  and  evaluations,  continual 
s t a t e— of — t he— ar t course  enhancements,  and  the  like. 


In  order 
your  assistance 
quest ionnaire • 


to  initiate  this  major 
in  completing  the 
This  questionnaire 


project,  we  are  requesting 
attached  needs  analysis 
is  being  distributed  to 
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Academic  Vice-Presidents  and  Deans  of  Colleges  of  Physical 
Sciences  and  Engineering  of  major  colleges  and  universities 
throughout  the  country.  The  questionnaire  is  intended  to  collect 
baseline  data  concerning  computer  usage  and  information  storage 
and  retrieval  system  usage  within  your  university’s  Physical 
Sciences  and  Engineering  c o 1 1 e g e s /depar tment s , your  assessment  of 
educational  needs  in  these  areas,  your  potential  interest  in  the 
results  of  our  efforts,  and,  of  course,  any  conments  which  you 
may  have  concerning  these  issues. 

We  feel  that  the  colleges  and  universities  that  do 
participate  in  these  activities  will  benefit  from  the  results  of 
our  efforts  in  a niunber  of  ways,  including  enhanced  educational 
opportunities  for  their  undergraduate  science  and  engineering 
students,  enhanced  marketability  of  graduating  students,  enhanced 
opportunities  for  contract  research  and  development  work  with  the 
agencies  whose  systems  will  be  addressed  within  the  courses,  and 
numerous  additional  benefits. 

Please  return  completed  questionnaires  not  later  than  April 
30,  1984  to: 

Dr.  Wayne  D.  Dominick 
NASA/ RECON  PROJECT 
University  of  Southwestern  Louisiana 
Computer  Science  Department 
P.  O.  Box  44330 
Lafayette,  LA  70504 

If  you  have  any  questions  concerning  the  needs  analysis 
questionnaire,  please  feel  free  to  contact  any  of  the  undersigned 
individual s . 


Thank  you  in  advance  for  your  very  important  participation 
in  the  needs  analysis  phase  of  this  project. 


Sincerely, 


Wayne  D.  Dominick 
NASA/RECON  Contract 
USL  Co-Principal  Investigator 
(318)  231-6308 


Leroy  Roqu^pliore 
NASA/RECON  Contract 
SU  Co-Principal  Investigator 
(504)  771-2060 


H.  Wilson,  Jf' 
tSA  Scientific  & Technical 
Information  Branch 


USL/SU  NASA/RECON  Contract  Monitor 
(202)  453-2904 


At  tachment 


ATTACHMENT  2.3 


NEEDS  ANALYSIS  PHASE: 


NEEDS  ANALYSIS  QUESTIONNAIRE 


TRANSPORTABLE  INFORMATION  STORAGE  AND  RETRIEVAL  SYSTEM  CX)URSES 

NEEDS  ANALYSIS  QUESTIONNAIRE 


Position  of  Respondent: 
Institution  Name: 

Addre  s s : 


Note:  Throughout  the  questionnaire,  if  more  than  one  answer  to  a 
question  is  applicable,  please  check  all  that  apply. 


PART  1 

INFORMATION  ABOUT  THE  UNIVERSITY 

1.1  Different  universities  place  emphasis  on  different 

educational  objectives.  The  following  is  a brief  list  of 
possible  objectives  that  may  or  may  not  be  stressed  by  your 
uni  ve'r  s i ty . 

For  each  group,  please  check  the  response  corresponding  to 
how  important  an  item  is  for  a senior  undergraduate  student 
within  your  university  in  Physical  Sciences  and  Engineering. 

Computer  Usage 


Phys i ca 1 

Sciences  Engineering 

Very  important  (e.g.,  more  than  2 classes  required)  

Important  (e.g.,  1 to  2 classes  required)  

Desirable  (e.g.,  not  required, but  highly  recommended)  

Optional  (at  the  student's  discretion)  

Not  applicable  


Research  Skills 

Very  Important  (e.g..  Baccalaureate  Thesis  required) 

Important  (e.g.,  formal  training  in  research 

techniques  required) 
no  formal  training,  but 
some  skills  expected) 


Desirable  (e.g.. 
Optional 
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1-2  Which  of  the  following  describe  the  access  of  students  in 
Physical  Sciences  and  Engineering  departments  to  computing 
facilities? 

Phy s i cal 

Sciences  Engineer ing 

Terminals  in  the  department  used  to  access  a computer  

located  on  the  c amp u s 

Terminals  in  the  department  used  to  access  a remote  

computer  not  on  the  campus 

Terminals  located  in  some  other  location  outside  of  

the  department 

Personal  computer  workstations  located  in  the  

department 

Personal  computer  workstations  available  for  use  but  

not  located  in  the  department 


PART  2 

INFORMATION  STORAGE  AND  RETRIEVAL  SYSTEM  USAGE 

2*1  Are  online  information  storage  and  retrieval  systems 
available  for  use  by  students  at  your  university? 

YES  NO  UNDECIDED 

(If  ”NO” , please  skip  this  section  and  go  to  PART  3) 

2.2  To  which  departments  are  these  systems  available? 


All  Physical  Sciences  departments 
All  Engineering  departments 

Only  specific  Physical  Sciences  and/or  Engineering 
departments:  Please  specify  which  departments 


Other  departments:  Please  specify  which  departments 
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2.3  Which  systems  are  available? 


BASIS 

BROWSER 

BRS 

CAN/OLE 

CAS 

CGIS 

CSIN 

DATA  CENTRAL 

DIALOG 


DTIC/DROLS 

ENERGY/ RECON 

IGS 

ISI 

LEADER 

MEDLINE 

NASA/ RECON 

OCLC 

ORBIT 


PERGAMDN/ INFOLINE 

QUESTEL 

SPIRES 

STAIRS 

TIS 

Inhouse  system(s) 

Other( s ) : 

Please  specify: 


2.4  Are  these  systems  available  to: 

Faculty 

Staff 

Students  for  coursework 

Students  for  research 

The  general  student  body 

The  general  public 


2.5  How  is  the  availability  of  database  searching  advertised? 

News  letters 

Seminars 

Non-credit  courses 

For-credit  courses 

Other:  Please  specify:  


2.6  Select  the  person(s)  responsible  for  conduc  t ing  on 1 i ne 
searches  at  your  university: 


Librarian 

Other  staff 

Facul ty 

Students 

Any  trained  individual 


2.7  What  funding  source(s)  are  used  to  pay  for  the  services? 

User 

Department 

Uni ver s i ty 

External  Grant ( s ) /Cont rac t ( s ) 

Other:  Please  specify:  
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PART  3 


INFORMATION  STORAGE  AND  RETRIEVAL  SYSTEM  EDUCATIONAL  NEEDS 


3.1  Would  your  university  be  interested  in  offering  your 
Physical  Sciences  and  Engineering  students  an  opportunity  to 
learn  the  principles  and  concepts  of  online  information  storage 
and  retrieval  systems,  to  understand  the  types  of  scientific  and 
engineering  database  services  that  are  available,  and  to  interact 
wi th  such  syst ems  and  services? 

YES  NO  UNDECIDED 

ALREADY  OFFERING  PRECISELY  SUCH  COURSES 

3.2  What  f o rma t ( s ) / dur a t i on( s ) do  you  feel  such  an  educational 
program  should  take? 

2-3  days  workshops 

4-6  week  mini-courses 

Full  quarter  courses 

Full  semester  courses 

3.3  Do  you  feel  that  formal  education  in  these  areas,  coupled 
with  hands-on  experience  with  one  or  more  major  online  retrieval 
systems  such  as  NASA/RECON,  would  appreciably  increase  the 
professional  marketability  of  your  graduating  scientists  and 
engineers? 

YES  NO  UNDECIDED 

3.4  If  your  answer  to  the  preceding  question  was  "YES’* , did  you 
base  your  opinion  on: 

Needs  expressed  by  faculty,  students  and/or  alumni? 

Requirement  s expressed  by  potential  employers  of 

your  graduates? 

Exper i ence  gained  through  participation  in  research 

grants  and/or  contracts? 

Knowledge  gained  through  professi onal  literature? 

Other:  Please  specify:  

3.5  What  do  you  forsee  as  the  major  obstacles  toward  teaching 
and  utilizing  information  storage  and  retrieval  systems  more 
extensively  at  your  university? 

Diverse  departmental  needs 

Logistical  problems 

Availability  of  comprehensive  course  materials 

Availability  of  funding 

Other:  Please  specify:  

None 
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PART  4 


INFORMATION  STORAGE  AND  RETRIEVAL  SYSTEM  EDUCATIONAL  COURSES 


4.1  When  transportable  information  storage  and  retrieval  system 
courses  are  available,  would  your  university  be  interested  in 
incorporating  the  pre-packaged  educational  program  into  your 
Physical  Sciences  and/or  Engineering  curricula? 

YES  NO 


QUALIFIED:  Consideration  would  be  contingent  upon: 

The  university*s  opportunity  for  input  into,  the  development 

phases  of  the  courses 

The  possibility  of  pre-evaluation  of  all  course  materials 

The  availability  of  onsite  seminars,  demonstrations  and/or 

teaching  assistance 

The  possibility  of  funding  support  for  system  access  costs 

Other;  Please  specify:  


4.2  Which  of  the  following  educational  materials  would  you  like 
to  see  incorporated  within  the  transportable  course  packages: 


Course 

syl 1 abi 

Discussion  topics 

Lesson 

p 1 ans 

Workbooks 

Overlie 

ad  transparanc i e s 

Textbooks 

Homework  ass  ignment 

(with  answer  keys) 
Hands-on  usage  assignments 
(with  answer  keys) 
Examinat  ions 

(with  answer  keys 


Bibliographies 

Support  handouts 

Videotapes  and/or  films 

Other:  Please  specify: 


PART  5 


CCMvlENTS 


Thank  you  very  much  for  completing  this  questionnaire. 

If  you  wish  to  add  any  comnents  about  any  of  the  specific 
questions  asked,  please  feel  free  to  do  so. 


Question  Conments 

Number 


General  Comments: 


If  you  would  like  to  receive  a sunmary  of  this  survey  and/or 
more  information  about  the  contract  activities,  please  check  the 
foil owi ng  it ems  : 

Would  like  to  receive  a sunmary  of  the  results  of  this  survey. 

Would  like  to  be  placed  on  our  mailing  list  for  dissemination 

of  information  related  to  the  contract  activities. 
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ATTACHMENT  2.4 


NEEDS  ANALYSIS  PHASE: 
NEEDS  ANALYSIS  aUESTIONNAIRE 


RESULTS 


TRANSPORTABLE  INFORMATION  STORAGE  AND  RETRIEVAL  SYSTEM  COURSES 

NEEDS  ANALYSIS  QUESTIONNAIRE 
INTERPRETATION  SIM4ARY 

The  needs  analysis  questionnaire  was  distributed  to  237 
colleges  and  universities  in  April,  1984  and  was  completed  and 
returned  by  161  respondents.  This  document  represents  an  overview 
of  the  analysis  of  those  responses.  All  percentages  indicated  in 
the  s unmary  represent  a proportion  of  the  number  of  respondents 
who  actually  responded  to  the  specific  question. 

EDUCATIONAL  OBJECTIVES 

The  results  demonstrated  that  computer  usage  was  considered 
to  be  more  important  in  the  Engineering  Departments  of  the 
universities  surveyed  (86.8%  Very  Important  or  Important)  than  in 
the  Physical  Science  Departments  (68.2%  Very  Important  or 

Important).  On  the  other  hand,  development  of  research  skills  was 
considered  a more  important  objective  in  the  Physical  Science 
Departments  (59.7%  Very  Important  or  Important)  than  in  the 
Engineering  Departments  (48.8%  Very  Important  or  Important). 

CXMPUTER  ACCESS 

Engineering  departments  have  a slightly  higher  incidence  of 
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computing  facilities  located  in  the  department  as  would  be 
expected  from  the  results  of  the  previous  section.  The  difference 
is  not,  however,  significant.  The  survey  demonstrated  that  the 
responding  universities  do  have  substantial  computing  facilities 
available  to  both  Physical  Science  and  Engineering  Departments 
and  that  the  availability  of  local  computing  access  facilities  to 
support  the  implementation  of  online  training  sessions  should  not 
present  a major  obstacle  to  implementation  of  the  proposed 
cour  s e . 

IS&R  SYSTEM  USAGE 

Of  the  161  universities  responding  to  the  survey,  116  (72%) 
reported  the  availability  of  one  or  more  IS&R  systems  on  campus. 
The  systems  were  reported  as  being  available  to  Physical  Science 
students  in  76.6%  of  the  universities  responding  and  to 
Engineering  students  in  68.2%  of  the  universities  responding. 
The  maximum  number  of  systems  available  at  any  one  university  was 
15  and  the  average  number  available  at  those  locations  which  had 
any  availability  was  4.5.  Twenty-five  of  the  locations  reported 
the  availability  of  only  one  system  on  their  campus.  The  most 
popular  system  was  DIALOG  (88  locations)  followed  by  BRS  (56), 
OCLC  (54),  ORBIT  (42)  and  MEDLINE  (40).  The  NASA/RECON  system  was 
available  at  20  locations.  Twenty-six  universities  possessed 
in-house  systems. 

The  systems  were  almost  universally  available  to  faculty  and 
staff  and  87%  of  the  universities  had  these  systems  available  to 
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students  for  research  activities.  The  systems  were  available  to 
students  for  coursework  in  68.7%  of  the  locations  and  to  the 
general  student  body  in  60%.  The  systems  were  made  available  to 
the  general  public  at  41  universities  (35.7%). 

Librarians  conducted  online  searches  at  94.8%  of  the 
universities.  Faculty  and  staff  conducted  online  searches  at 
22.4%  of  the  locations  reporting.  Students  were  reported  as 
conducting  searches  at  only  8.6%  of  the  universities  but  18.1% 
reported  that  any  trained  individuals  had  access  to  online  search 
c apab i 1 i t i e s . 

The  funding  sources  for  fees  associated  with  online  searches 
represented  a mixture, of  sources.  Payment  of  fees  by  users  was 
reported  by  73.1%  of  the  repondents  and  payment  by  departments  at 
64.3%.  A significant  percentage  of  the  universities  (61.7%) 
reported  the  availability  of  grant  or  contract  funds  to  cover 
these  expenses.  The  university  provided  some  funding  support  for 
these  activities  in  53%  of  the  locations  reporting. 

IS&jR  SYSTEM  EDUCATIONAL  NEEDS 

The  survey  indicated  that  7.5%  of  the  universities 
responding  already  offered  courses  to  the  targeted  students  and 
that  67.7%  would  be  interested  in  offering  such  a course.  Only 
2.5%  indicated  that  they  would  not  be  interested  in  the  course; 
21.7%  indicated  that  they  were  presently  undecided.  The  most 
popular  course  configuration  (76.1%)  was  a 2-3  day  workshop 
(presumably  to  teach  the  specifics  of  a particular  course).  There 
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were  also  35  schools  (25.4%)  who  were  interested  in  a 4—6  week 
mini-course  and  26  (18.9%)  who  were  interested  in  a full  semester 
or  quarter  course.  Nearly  half  of  the  respondents  felt  strongly 
that  the  course  would  contribute  to  the  marketability  of  their 
graduates,  22.9%  felt  that  it  would  not  and  28.7%  were  undecided. 
Funding  was  seen  as  the  major  obstacle  to  course  implementation 
by  82%  of  the  universities  responding. 

IS&R  EDUCATIONAL  COURSES 

The  overwhelming  majority  of  the  universities  responding 
(86. 4% ) indicated  interest  in  incorporating  a pre-packaged 
program  into  their  curr  iculxim  when  the  course  becomes  available. 
The  most  frequently  mentioned  qualifications  to  incorporation 
were  funding  support  (81.5%)  and  preevaluation  of  the  course 
materials  (69.2%).  The  most  requested  educational  materials  were 
course  syllabi  (73.5%)  and  hands-on  usage  assignments  (65.2%). 
Lesson  Plans  (53.8%),  Overhead  Transparencies  (55.3%),  Homework 
Assignments  (49.2%),  Workbooks  (60.6%),  Textbooks  (51.5%), 
Bibliographies  (43.2%),  Support  Handouts  (62.1%),  and 
Videotapes/Films  (47.7%)  were  all  requested  by  over  40%  of  the 
respondents.  Only  Examinations  (38.6%)  and  Discussion  Topics 
(39.4%)  were  considered  desirable  by  less  than  40%  of  the 
re  spondent  s • 
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TRANSPORTABLE  -INFORMATION  STORAGE  AND  RETRIEVAL  SYSTEM  COURSES 

NEEDS.  ANALYSIS  QUESTIONNAIRE 


ANALYSIS  RESULTS  SUMMARY 


POSITION  OF  RESPONDENT 

ABSOLUTE 

FREQ 

RELATIVE 

(%) 

PRESIDENT .VICE- PRES 

32 

19.9 

DEAN.ASST-DEAN 

62 

38.5 

HEAD  OF  DEPT 

21 

13.0 

FACULTY  MEMBER 

16 

9.9 

OTHER 

30 

18.6 

TOTAL 

161 

100.0 

PART  L INFORMATION  ABOUT  THE  UNIVERSITY 


1 Edwpat  ii  onq  1 Objectives 
(Computer  Usage ) 


ABSOLUTE 

RELATIVE  FREQ 

PHYSICAL  SCIENCES 

FREQ 

(%) 

VERY  IMPORTANT 

38 

28 . 8 

IMPORTANT 

52 

39.4 

DESIRABLE 

29 

21 .9 

OPTIONAL 

2 

1.5 

NOT  APPLICABLE 

11 

8.5 

(SAMPLE  SIZE,  N = 132) 

ABSOLUTE 

RELATIVE  FREQ 

ENGINEERING 

FREQ 

(%) 

VERY  IMPORTANT 

81 

59.1 

IMPORTANT 

38 

27.7 

DESIRABLE 

2 

1 .5 

OPTIONAL 

1 

0.7 

NOT  APPLICABLE 

15 

10.9 

(N  = 137) 
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J_JL  Edpcat  iionali  Objectives 
(JRgggargh  Skills) 


ABSOLUTE  RELATIVE  FREQ 
PHYSICAL  SCIENCES  FREQ  (%) 

VERY  IMPORTANT  17  14.3 

IMPORTANT  54  45.4 

DESIRABLE  43  36.1 

OPTIONAL  5 4.2 

(N  = 119) 

ABSOLUTE  RELATIVE  FREQ 
EhKHNEERING  FREQ  {%) 

VERY  IMPORTANT  12  10.1 

IMPORTANT  46  38.7 

DESIRABLE  55  46.2 

OPTIONAL  6 5.0 

(N  = 119) 

JLi.2.  Computer  Access 

ABSOLUTE  RELATIVE  FREQ 
PHYSICAL  SCIENCES  FREQ  (%) 

ON-CAMPUS  DEPT  TERMINALS  94  79.7 

OFF-CAMPUS  REMyPE  TERMINALS  28  23.7 

OUTSIDE  OF  DEPT  TERMINALS  80  67.8 

PC  IN  DEPT  70  59.3 

PC  OUT  OF  DEPT  44  40.0 

(N  = 118) 

ABSOLUTE  RELATIVE  FREQ 
ENGINEERING  FREQ  (%) 

ON-CA\fi»US  DEPT  TERMINALS  104  86.7 

OFF-CAMPUS  REMOTE  TERMINALS  28  23.3 

OUTSIDE  OF  DEPT  TERMINALS  7 8 65.0 

PC  IN  DEPT  80  66.7 

PC  OUT  OF  DEPT  42  35.0 

(N  = 120) 
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PART  X XS&E.  SYSTEM  USAGE 


2 t 1 On-Line  IS&R 


ABSOLUTE  RELATIVE  FREQ 
FREQ  (%) 


YES 

116 

72.0 

NO 

40 

24.8 

UNDECIDED 

5 

3 . 1 

(N  = 161) 

2,2  -Systems 

. Ava i lab 

l£.  To.  Departments 

ABSOLUTE 

RELATIVE  FREQ 

FREQ 

(%) 

PHYS  SCIENCE  DEPTS-ALL 

82 

76.6 

ENGINEERING  DEPTS-ALL 

73 

68.2 

ONLY  SPECIFIC  DEPTS 

6 

5.6 

OTHER  DEPTS 

51 

47.7 

(N  = 107) 

2-JL  Aval  lable 

Systems 

ABSOLUTE 

RELATIVE  FREQ 

FREQ 

(%) 

BASIS 

2 

1.7 

BROWSER 

0 

0.0 

BRS 

56 

48.3 

CAN/OLE 

2 

1.7 

CAS 

24 

20.7 

CGIS 

1 

0.9 

CSIN 

5 

4.3 

DATA  CENTRAL 

5 

4.3 

DIALOG 

88 

75.9 

DTIC/DROLS 

1 

0.9 

ENERGY/ RECON 

18 

15.5 

IGS 

1 

0.9 

ISI 

22 

19.0 

LEADER 

0 

0.0 

MEDLINE 

40 

34.5 

NASA/ RECON 

20 

17.2 

OCLC 

54 

46.6 

ORBIT 

42 

36.2 

PERGANON/  INFOLINE 

9 

7.8 

QUESTEL 

9 

7.8 

-7- 


SPIRES 

16 

13.8 

STAIRS 

3 

2.6 

TIS 

0 

0.0 

Inhouse  System(s) 

26 

22.4 

Othe r ( s ) : 

32 

27.6 

ALIS/IDS 

2 

1.7 

ANL 

1 

0.9 

BOEING  INFO  SYS 

1 

0.9 

CYNET 

1 

0.9 

DATA-TRIEVE  (DEC) 

1 

0.9 

D&B 

1 

0.9 

DISCOVER 

1 

0.9 

FAXON 

1 

0.9 

GEOREF 

1 

0.9 

ICTSR 

1 

0.9 

LEXIS 

3 

2.6 

RAMIS 

1 

0.9 

RLIN 

5 

4.3 

RTS 

1 

0.9 

SIR 

2 

1 .7 

SYSTEM  1.72 

1 

0.9 

SYSTEM  1032 

1 

0.9 

TECH  DATA 

1 

0.9 

VUTEXT/DOV  JOISIES 

2 

1.7 

WESTLAW 

2 

1.7 

NOT  SPECIFIED 

2 

1.7 

(N  = 116) 


J2-^  Systms  Aval  lable  Xa  Bodies 


FACULTY 

STAFF 

STUDENT  COURSEVVDRK 
STUDENT  RESEARCH 
GENERAL  STUDENT  BODY 
GENERAL  PUBLIC 

(N  = 115) 


ABSOLUTE  RELATIVE  FREQ 


FREQ 

(%) 

113 

98.3 

104 

90.4 

79 

68.7 

100 

87.0 

69 

60.0 

41 

35.7 
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Data  £a.se  Searching  Advertised 


ABSOLUTE 

FREQ 


NEWSLETTERS  76 

SEMINARS  46 

NON-CREDIT  COURSES  17 

FOR-CREDIT  COURSES  28 

OTHER:  42 

Brochures  7 

Demos  & Lectures  by 
Library  Staff  9 

Fliers  2 

Internal  Memos  3 

Posters  4 

Through  Reference  Librarian  10 
Word  of  Mouth  7 

(N  = 110) 


RELATIVE 

(%) 


FREQ 


69.1 
41 .8 

15.5 

25.5 

38.2 


6.4 

8.2 

1.8 


2 

3 

9 


6.4 


2-iA  Party  £.S.&pons  iblg  for  Online  Searche  s 
ABSOLUTE  RELATIVE  FREQ 


LIBRARIAN 
OTHER  STAFF 
FACULTY 
STUDENTS 

ANY  TRAINED  INDIVIDUAL 


FREQ 

(%) 

110 

94.8 

26 

22.4 

26 

22.4 

10 

8.6 

21 

18.1 

(N  = 116) 


2 . 7 Funding  Source ( s ) 


ABSOLUTE 

RELATIVE 

FREQ 

(%) 

USER 

82 

71.3 

DEPARTMENT 

74 

64.3 

UNIVERSITY 

61 

53.0 

GRANT( S ) /CONTRACT( S ) 

71 

61,7 

OTHER 

13 

11,3 

Ag  r e erne  n t Wi  t h Own  e r 

1 

0.8 

Cash  by  Non-af f i 1 i a t ed 

User  2 

1 .7 

Library 

7 

6.1 

Not  Spec i f i ed 

3 

2.6 

(N  = 115) 
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2AM.  2.  XS&R  .SYSTEM  EDUCATIONAL  NEEDS 
,2_>_L  Cour  s e Interest 


YES 

NO 

UNDECIDED 
PRESENTLY  OFFERING 

(N  = 160) 


ABSOLUTE 

RELATIVE 

FREQ 

(%) 

109 

67.7 

4 

2.5 

35 

21 .7 

12 

7.5 

FREQ 


2tl  Format ( s ) /Durat i on( s ) 


ABSOLUTE 

RELATIVE 

FREQ 

(%) 

2-3  DAYS  WORKSHOPS 

105 

76.1 

4-6  WEEKS  MINI -COURSES 

35 

25.4 

FULL  QUARTER  COURSE 

11 

8.0 

FULL  SEMESTER  COURSES 

15 

10.9 

(N  = 138) 


3,.  3 Marketabi  1 i ty 

ABSOLUTE  RELATIVE  FREQ 


FREQ  (%) 

YES  76  48.4 
NO  36  22.9 
UNDECIDED  45  28.7 


(N  = 157) 
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3-.. 4 £a sis  for  Opinion 


ABSOLUTE 

RELATIVE 

FREQ 

(%) 

FAC  STDNT  ALUMNI  NEEDS 

36 

47.4 

POTENTIAL  IMPLOYERS 

29 

38.2 

GRANT  EXPERIENCE 

43 

56. 6 

PROFESSIONAL  LITERATURE 

37 

48.7 

OTHER 

9 

11.8 

ACS  Me  e t i ng 

1 

1 .3 

Comnon  Sense 

1 

1 .3 

Di s cus s i on  Wi  th  Collea 

gue  s 1 

1.3 

Li  bra  r i an 

1 

1 .3 

Personal  Experience 

4 

5.3 

Not  Spec i f i ed 

1 

1.3 

(N  = 76) 


■3..t.5.  Ma-j or  Obstacles 


ABSOLUTE 

FREQ 

RELATIVE  FREQ 
(%) 

DIVERSE  DEPT  NEEDS 

54 

35 . 8 

LOGISTICAL  PROBLEMS 

47 

31 . 1 

MATERIALS  AVAILABILITY 

29 

19.2 

FUNDIM3  AVAILABILITY 

124 

82 . 1 

OTHER 

33 

21.9 

A V ailability  of  Faculty 

2 

1 .3 

Availability  of  Resources 

6 

4.0 

Cost 

3 

2.0 

Crowded  Curriculum 

7 

4.6 

Faculty  Inertia 

Low  Priority  in  Relation  to 

3 

2.0 

Other  Requirements 
Unnecessary  at  Under- 

5 

3.3 

graduate  Level 
Uncertainty  About  True 

3 

2.0 

Generality  of  IS&R  Systems 

1 

0.7 

Not  Specified 

3 

2.0 

NONE 

3 

2.0 

(N  = 151) 
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£A£X  A Jg&R  ^STEM  EDUCATIONAL  COURSES 
A-l±  Incorporat  ing  I S&R  Courses 
ABSOLUTE  RELATIVE  FREQ 


FREQ 


(%) 


YES 

8 

5.0 

NO 

20 

12.4 

QUALIFIED 
(N  = 159) 

131 

81.4 

A.L  ( cont 

_lil  Qual  i f i cat  ion 

ABSOLUTE 

RELATIVE 

FREQ 

(%) 

UNIVERSITY  INPUT 

30 

23 . 1 

PRE- EVALUAT I ON 

90 

69.2 

ONSITE  TRAINING 

61 

46.9 

FUNDING  SUPPORT 

106 

81.5 

OTHER 

Clear  Demonstration  of 

17 

13.1 

Real  Va 1 ue 
Comp  atability  Wi  t h 

1 

0.8 

Present  Resources 
Consultation  With 

3 

2.3 

Appropriate  Officials 
Determination  of  Student/ 

2 

1.5 

Facul ty  Interest 

3 

2.3 

Non  Credit  Basis 
Relative  Importance  With 

3 

2.3 

Other  Courses 

3 

2.3 

No t Specified 

2 

1.5 

FREQ 


(N  = 130) 
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.4 1.2.  Educa  t i ona  1 Mate  rials 


ABSOLUTE 

RELATIVE 

FREQ 

(%) 

CX3URSE  SYLLABI 

97 

73.5 

LESSON  PLANS 

71 

53 . 8 

OVERHEAD  TRANSPARENCIES 

73 

55.3 

HCMEVMORK  ASSIG>MENTS 

65 

49.2 

HANDS-ON  USAGE  ASSIGhMENTS 

86 

65.2 

EXAMINATIONS 

51 

38.6 

DISCUSSION  TOPICS 

52 

39.4 

WORKBOOKS 

80 

60.6 

TEXTBOOKS 

68 

51 .5 

BIBLIOGRAPHIES 

57 

43.2 

SUPPORT  HANDOUTS 

82 

62.1 

VI DEOTAPES / F I IMS 

63 

47.7 

OTHER 

9 

6 . 8 

Ab s t r ac  t s 

1 

0.8 

Computer  Aided  Instruction 

4 

3.0 

Online  Tutorials 

3 

2.3 

No t Specified 

1 

0.8 

(N  = 132) 
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2AM.  i.  COMMENTS 


Spec  if ic  Comnents 

ABSOLUTE  RELATIVE  FREQ 
FREQ  (%) 

NO  COVMENTS  136  84.5 

SPECIFIC  COMMENTS  25  15.5 

(N  = 161) 

Cgngral  Comnent  s 

ABSOLUTE  RELATIVE  FREQ 
FREQ  (%) 

NO  COMMENTS  137  85.1 

GENERAL  COMMENTS  24  14.9 

(N  = 161) 

SwnnarY  Request 

ABSOLUTE  RELATIVE  FREQ 
FREQ  (%) 

NO  REQUEST  65  40.4 

SIMMARY  REQIBST  96  59.6 

(N  = 161) 

Mailing  Reque s t 

ABSOLUTE  RELATIVE  FREQ 
FREQ  (%) 

NO  REQUEST  86  53.4 

MAILING  LIST  REQUEST  75  46.6 

(N  = 161) 
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TRANSPORTABLE  INFORMATION  .STOPAGE  AND  RETRIEVAL  SYSTEM  COURSES 


NEEDS  ANALYSIS  QUESTIONNAIRE 


CaVMENTS  OE  THE  RESPONDENTS  ^ SUMvIARY 


[The  numbers  in  the  parentheses  are  specific  question  numbers  (if 
specified)] 

This  college  has  not  given  serious  thought  to  this  issue. 
However,  as  the  institution  expands  its  research  capability,  this 
activity  may  well  become  higher  in  priority. 

All  students  own  powerful  personal  computer  DECPro350.  Campus  to 
be  networked  withen  18  months. 

Funding  both  in  terms  of  computer  time  and  staff  time  is  the  main 
impediment  to  this  type  of  instruction;  we  have  provided  a 
limited  introduction  to  searching  to  a number  of  engineering 
classes  over  the  past  12  years. 

As  with  many  other  universities  information  retrieval  from  data 
bases  such  as  those  mentioned  is  usually  for  bibliographic 
information  and  is  therefore  handled  by  the  library.  If  an 
undergraduate  research  methods  course  were  offered  then  the 
students  could  be  introduced  to  online  information  retrieval  and 
it  would  not  necessarily  be  limited  to  bibliographic  information. 
However  this  course  is  not  currently  being  considered  within  the 
department  of  Geology. 

Determination  of  s tudent /f acul ty  interest  and  willingness  to 
participate  probably  on  a non-credit  basis.  ( 4.1) 

Transportable  instruction  should  be  in  the  fo  rm  o f wr  i 1 1 e n 
materials,  films,  tapes,  etc.  that  can  be  viewed  by  users  when 
they  feel  it  appropriate.  The  strongest  motivation  is  need  to 
know. 

Departments  are  using  our  information  retrieval  system  and  many 
are  providing  instruction  through  library  - we  see  instruction 
(formal  & otherwise)  as  evolving  on  campus.  If  NASA  supports 
instructional  courseware  on  information  retrieval  then  I would 
agree  that  colleges  and  universities  would  have  low  or  no  cost  to 
users  . 

In  discussing  this  questionnaire  with  my  10  department  heads  they 
felt  that  a very  short  briefing  (2  to  3 hours)  was  more  than 
ample  to  demonstrate  the  system;  our  faculty  and  staff  have  no 
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problem  using  it  with  such  a briefing. 

Physical  science:  These  systems  would  be  useful  only  for 
literature  search;  mainly  graduate  students  and  faculty  would  use 
them.  I believe  they  would  have  minimal  value  for 
unde  rgraduates . 

I would  rather  see  students  spend  time  .and  effort  on  fundamentals 
of  DBMS  and  records  management  than  on  specific  bibliographic 
retrieval  packages. 

It  might  be  more  appropriate  to  incorporate  learning  these  skills 
within  the  framework  of  advanced  courses  in  the  major  discipline. 

Materials  should  be  available  as  tutorials  - online  to  the  most 
conmon  mainframes  eg  I Ad,  CDC.  (4.2)  Outmoded  learning  tools  for 
these  c omp u t e r ma terials.  (4.2) 

The  questionnaire  suggests  that  those  planning  the  system  are  not 
familiar  with  modern  use  of  computer  databases.  Some  help  from 
comnercial  designers  would  be  advisable. 

University  has  no  funding  at  present  to  allow  for  extensive 
participation. 


So  far  no  interest  in  end-user  training  has  been  expressed.  (3.5) 
I would  be  interested  in  the  design  of  the  course.  (4.1) 

Clear  demonstration  of  real  value.  (4.1) 

Importance  relative  to  other  curriculum  requirements.  (4.1) 

Could  you  please  condense  the  content  of  the  cover  letter  to  a 
more  clear  statement  of  purpose.  It  was  unclear  to  me  as  it  is 
wr  i 1 1 e n . 

Could  this  system  be  used  to  catalog  abstracts  from  the 
engineering  libraries  in  the  system? 

At  the  point  when  you  decide  to  proceed  you  should  contact  dept, 
cha i r s . 

We  see  a great  need  and  usefulness  in  online  searching  of  the 
literature.  We  are  however  extremely  limited  by  the  amount  of 
available  funding  to  do  these  searches.  Secondary  matters  such 
as  familiarity  with  search  techniques  could  easily  be  overcome. 

Most  physical  science  majors,  are  computer  literate  but  only  a 
small  portion  know  how  to  retrieve  information  from  a central 
data  base. 
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To  modify  for  own  use  (4.1).  Except  for  introductory  courses 
c omp uter  skills  develo pme nt  should  be  incorporated  in  general 
course  work  (3.2).  A model  course  would  be  a useful  guideline 
for  developing  material  for  incorporation  into  our  own  courses. 
(4.1) 

Once  students  have  developed  good  computer  habits  in  connection 
with  their  coursework,  it  is  relatively  easy  for  them  to  learn 
the  protocol  of  user  friendly  software.  Then  we  must  make  such 
software  available  and  make  students  aware  of  the  availability. 

Compatibility  with  present  resources.  (4.1)  Incoporate  as  part 
of  another  course. 

CAI  w/video  disk  overlays,  such  as  DEC*s  IVIS  System.  (4.2) 

At  this  time  the  continual  s tat e— of —the— art  evolution  involved  in 
online  database  searching  creates  a time  investment  vs.  return 
(on  that  time  investment)  problem  for  the  end  user  as  searcher. 
More  important  unless  the  end  user  is  online  2-5  hrs/mo,  there 
probably  will  be  a problem  performing  cost  effective  searches.  I 
realize  that  database  suppliers  might  see  some  profit  in  this 
pr ob 1 em. 

Curricula  are  full.  Something  must  go  if  done  as  a course.  (3.5) 
Computer  Assisted  Instruction  modules  would  be  useful  if  they 
could  be  placed  on  disks  and  used  in  micro-computers.  (4.2) 

Involvement  of  our  own  professionals.  (4.2)  We  will  be  more 
activily  responding  to  the  Departmental  requests  as  awareness 
with  the  implementation  of  a campus  network  over  the  next  year  or 
so . (3.1) 

Discussions  with  other  professional.  (3.4) 

Av ailability  of  interested  faculty.  (3.5)  Wi  11  certainly  increase 
competence.  Not  clear  that  increases  their  marketability.  I 
think  you  should  involve  the  library  profession  in  your 
evaluat ion . 

If  these  are  in  form  for  self-learning.  (4.1) 

Not  generally.  Some  are  available  through  the  University 
Library,  but  I can  not  answer  specific  questions  about  these 
services.  (2.1) 

In  a university  of  our  size  & diversity,  only  department  heads 
know  the  answers  to  some  of  your  questions. 

As  with  other  courses  to  be  introduced,  the  question  is  where  do 
we  fit  them;  what  do  we  eliminate? 
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Inertia.  (3.5).  Everyone  here  will  have  an  lai  PC  or  PC/XT 
within  5 years.  Software  Acronyms  are  for  too  numerous  for 
faculty  to  care  about. 

Faculty  and  students  use  the  services  but  are  not  interested  in 
doing  retrievals  thems e 1 ve s . ( 2 ) There  should  be  a course  in 
chemical  literature.  Most  students  and  faculty  are  deficient  in 
elementary  skills  with  Chem.  Abst.  Training  would  even  make  them 
better  clients.  (3)  I would  be  interested  in  the  course 
d e V e 1 0 pme  n t . ( 4 ) 

Not  a formal  course  but  an  optional  seminar.  (4.1) 

Limited  duration  (<1  day)  overview  is  envisioned.  (4.1)  Seminars 
or  short  workshops  (<  1 day)  would  be  sufficient  exposure  of 
overview  material.  Hands-on  usage  not  necessary  on  campus.  (3.2) 

Is  there  space  available  in  the  progr am?  (4.1) 
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TRANSPORTABLE  INFORMATION  STORAGE  AND  RETRIEVAL  SYSTEM  COURSES 

NEEDS  ANALYSIS  QUESTIONNAIRE 


Position  of  Respondent: 
Institution  Name: 

Add re  s s : 


Note:  Throughout  the  questionnaire,  if  more  than  one  answer  to  a 
question  is  applicable,  please  check  all  that  apply. 


PART  1 

INFORMATION  ABOUT  THE  UNIVERSITY 

1.1  Different  universities  place  emphasis  on  different 

educational  objectives.  The  following  is  a brief  list  of 
possible  objectives  that  may  or  may  not  be  stressed  by  your 
university. 

For  each  group,  please  check  the  response  corresponding  to 
how  important  an  item  is  for  a senior  undergraduate  student 
within  your  university  in  Physical  Sciences  and  Engineering. 

Computer  Usage 


Phys i ca 1 

Sciences  Engineer i ng 

Very  important  (e.g.,  more  than  2 classes  required)  

Important  (e.g.,  1 to  2 classes  required)  

Desirable  (e.g.,  not  required, but  highly  r econmended)  

Optional  (at  the  student’s  discretion)  

Not  applicable  


Re  search  Skills 


Very  Important 
Important  (e.g. 

Desirable  (e.g. 

Opt i ona 1 


(e.g..  Baccalaureate  Thesis  required) 
, formal  training  in  research 
techniques  required) 

, no  formal  training,  but 
some  skills  expected) 
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1.2  Which  of  the  following  describe  the  access  of  students  in 
Physical  Sciences  and  Engineering  departments  to  computing 
facilities? 

Phy s i ca  1 

Sciences  Eng ineering 

Terminals  in  the  department  used  to  access  a computer  

located  on  the  c amp u s 

Terminals  in  the  department  used  to  access  a remote  

c omp uter  not  on  the  c amp u s 

Terminals  located  in  some  other  location  outside  of  

the  department 

Personal  computer  workstations  located  in  the  

department 

Personal  computer  workstations  available  for  use  but  

not  located  in  the  department 


PART  2 

INFORMATION  STORAGE  AND  RETRIEVAL  SYSTEM  USAGE 


2.1  Are  online  information  storage  and  retrieval  systems 
available  for  use  by  students  at  your  university? 

YES  M)  UNDECIDED 

(If  **NO” , please  skip  this  section  and  go  to  PART  3) 

2.2  To  which  departments  are  these  systems  available? 


All  Physical  Sciences  departments 
All  Engineering  departments 

Only  specific  Physical  Sciences  and/or  Engineering 
departments:  Please  specify  which  departments 


Other  departments:  Please  specify  which  departments 
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2.3  Which  systems  are  available? 


BASIS 

BROWSER 

BRS 

CAN/ OLE 

CAS 

CGIS 

CSIN 

DATA  CENTRAL 

DIALOG 


DTIC/DROLS 

ENERGY/ RECON 

IGS 

ISI 

LEADER 

MEDLINE 

NASA/ RECON 

OCLC 

ORBIT 


PERGAMDN/ INFOLINE 

QUESTEL 

SPIRES 

STAIRS 

TIS 

Inhouse  system(s) 

Othe  r ( s ) : 

Please  spec i fy : 


2.4  Are  these  systems  available  to: 

Faculty 

Staff 

Students  for  coursework 

Students  for  research 

The  general  student  body 

The  general  public 


2 . 5 p How  is  the  availability  of  database  searching  advertised? 

News  letters 

Seminars 

Non-credit  courses 

For-credit  courses 

Other:  Please  specify:  


2.6  Select  the  person(s)  responsible  for  conducting  online 
searches  at  your  university: 

Librarian 

Other  staff 

Facul ty 

Students 

Any  trained  individual 


2.7  What  funding  source(s)  are  used  to  pay  for  the  services? 

Use r 

De  par  tme  n t 

Uni vers i ty 

External  Gr ant ( s ) /Cont r ac t ( s ) 

Other:  Please  specify:  
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PART  3 


INFORMATION  STORAGE  AND  RETRIEVAL  SYSTEM  EDUCATIONAL  NEEDS 


3.1  Would  your  university  be  interested  in  offering  your 
Physical  Sciences  and  Engineering  students  an  opportunity  to 
learn  the  principles  and  concepts  of  online  information  storage 
and  retrieval  systems,  to  understand  the  types  of  scientific  and 
engineering  database  services  that  are  available,  and  to  interact 
with  such  systems  and  services? 

YES  NO  UNDECIDED 

ALREADY  OFFERIMJ  PRECISELY  SUCH  COURSES 

3.2  What  f ormat ( s ) /dura t ion( s ) do  you  feel  such  an  educational 
program  should  take? 

2-3  days  workshops 

4-6  week  mini-courses 

Full  quarter  courses 

Full  semester  courses 

3.3  Do  you  feel  that  formal  education  in  these  areas,  coupled 
with  hands-on  experience  with  one  or  more  major  online  retrieval 
systems  such  as  NASA/RECON,  would  appreciably  increase  the 
professional  marketability  of  your  graduating  scientists  and 
eng ineer s? 

YES  NO  UNDECIDED 

3.4  If  your  answer  to  the  preceding  question  was  "YES**,  did  you 
base  your  opinion  on: 

Needs  expressed  by  faculty,  students  and/or  alumni? 

Requirements  expressed  by  potential  employers  of 

your  graduates? 

Experience  gained  through  participation  in  research 

grants  and/or  contracts? 

Knowledge  gained  through  professional  literature? 

Other:  Please  specify:  

3.5  What  do  you  forsee  as  the  major  obstacles  toward  teaching 
and  utilizing  information  storage  and  retrieval  systems  more 
extensively  at  your  university? 

Diverse  departmental  needs 

Logistical  problems 

A V ailability  of  c omp  rehensive  course  ma  t e r i a 1 s 

Availability  of  funding 

Other:  Please  specify:  

None 
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PART  4 


INFORMATION  STORAGE  AND  RETRIEVAL  SYSTEM  EDUCATIONAL  COURSES 


4.1  When  transportable  information  storage  and  retrieval  system 
courses  are  available,  would  your  university  be  interested  in 
incorporating  the  pre-packaged  educational  program  into  your 
Physical  Sciences  and/or  Engineering  curricula? 

YES  NO 

QUALIFIED:  Consideration  would  be  contingent  upon: 

The  university’s  opportunity  for  input  into  the  development 

phases  of  the  courses 

The  possibility  of  pre-evaluation  of  all  course  materials 

The  availability  of  onsite  seminars,  demonstrations  and/or 

teaching  assistance 

The  possibility  of  funding  support  for  system  access  costs 

Other:  Please  specify:  ^ 


4.2  W^ich  of  the  following  educational  materials  would  you  like 
to  see  incorporated  within  the  transportable  course  packages: 


Course  syllabi 

Lesson  plans 

Overhead  t r ans par anc i e s 

Homework  assignment 

(with  answer  keys) 

Hands-on  usage  assignments 

(with  answer  keys) 

Examinations 

(with  answer  keys 


Discussion  topics 

Workbooks 

Textbooks 

Bibliographies 

Support  handouts 

Videotapes  and/or  films 

Other:  Please  specify: 
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PAJRT  5 


COVMENTS 


Thank  you  very  much  for  completing  this  questionnaire. 

If  you  wish  to  add  any  conments  about  any  of  the  specific 
questions  asked,  please  feel  free  to  do  so. 


Question  Conments 

Number 


General  Conments: 


If  you  would  like  to  receive  a summary  of  this  survey  and/or 
more  information  about  the  contract  activities,  please  check  the 
f ol lowing  i terns  : 

Would  like  to  receive  a sunmary  of  the  results  of  this  survey. 

Would  like  to  be  placed  on  our  mailing  list  for  dissemination 

of  information  related  to  the  contract  activities. 
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ATTACHMENT  3.1 


COURSE  DEVELOPMENT  PHASE: 
STANDARDIZED  COURSE  MATERIAL 
DOCUMENTATION  TEMPLATES 


STANDARDIZED  COURSE  MATERIAL  DOCUMENTATION  TE3V1PLATES 


STANDARDIZED  COURSE  SYLLABUS  TEMPLATE 


COURSE  NAME:  Identification  of  the  name  of  the  course. 


OBJECTIVES:  Specification  of  the  primary  objectives  of  the 

course  in  terms  of  the  information  and/or 
experience  to  be  imparted  to  students  of  the 
course . 


PREREQUI S ITES : Specification  of  the  basic  prerequisites  expected 
of  prospective  students  of  the  course. 


SCHEDULING:  Specification  of  the  duration  of  the  course  in 

terms  of  the  number  and  type  of  instructor/student 
contact  hours  and/or  laboratory  hours. 

COURSE  FORMAT:  Specification  of  the  types  of  instructional 

formats  to  be  employed  in  the  course. 


REQUIREMENTS:  Specification  of  the  requirements  of  the  students 

in  the  course  in  terms  of  homework  assignments, 
hands-on  RECON  usage  assignments,  examinations, 
and  so  on.  For  graded  courses,  percentage  of  final 
grade  associated  with  each  requirement  is  also 
specified. 


COURSE  OVERVIEW:  Detailed  specification  of  the  major  topics  to 

be  addressed  within  the  course;  breakdown  of  major 
topical  areas  into  specific  c omp onent  subjects  to 
be  addressed;  and  specification  of  instructional 
duration  for  each  major  topical  area. 


REQUIREID  REIADINGS : Specification  of  alternative  required  reading 

material  and/or  text(s)  for  the  course. 
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POTENTIALLY  REQUIRED  READINGS:  Specification  of  the  types  of 

reading  material  that  may  potentially  be  required 
within  the  course,  depending  upon  instructor 
prerogative  and/or  availability  of  system  (RECX)N) 
and  data  base  documentation. 

REFERE!NCE  BIBLIOGRAPHY:  Identification  of  the  reference 

bibliography  provided  to  support  the  course. 


STANDARDIZED  LESSON  PLAN  TEMPLATE 


COUR  S E NAME : Identification  of  the  n ame  of  the  course. 


LESSON  N.\ME : Identification  of  the  name  of  the  lesson. 


LESSON  OBJECTIVE:  Identification  of  the  primary  objectives  of 

the  lesson  in  terms  of  the  information  to  be 
presented  to  the  student  within  this  lesson. 


^ A AND  EQU I PME3'4T  : Identification  of  the  presentation  me  d i a 

and  equipment  to  be  used  as  part  of  presenting 
this  less  on . 


REFERENCES:  Identification  of  the  specific  reference  material 

to  be  employed  in  the  preparation  for,  and 
presentation  of  this  lesson. 


METHOD  OF  PRESENTATION:  Identification  of  the  specific  method(s) 

of  instruction  to  be  employed  in  the  presentation 
of  this  les  son . 


LENGTH  OF  LESSON:  Identification  of  the  number  of  instructional 

hours  to  be  devoted  to  this  lesson. 


LEARNING  OBJECTTIVES : Identification  of  the  specific  learning 
objectives  associated  with  this  lesson  in  terms  of 
the  specific  capabilities  that  the  student  will 
gain  as  a result  of  having  taken  this  lesson. 
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PLAN  FOR  CONDUCTING  THE  LESSONi  Identification  of  the  major 

topical  areas  to  be  covered  within  this  lesson; 
the  order  of  their  presentation;  and  the  amount  of 
time  to  be  devoted  to  each  such  area. 


ASSIGhMENTS  : 


Identification  of  the  specific 

a s s i g nme  nts  associated  with  this 
assignments  may  include  reading 
homework  assignments,  and/or 

a s s i g nme  nts,  as  appropriate. 


out-of-c lass 
1 e s son . Such 
a s s i g nme  nts, 
RECON  usage 


STANDARDIZED  HOMEWORK  ASSIGhMENTS  TBNdPLATE 

LEARNING  OBJECTIVES:  Textual  description  of  the  motivation  for 

performing  this  homework  assignment  and  the 
learning  objectives  associated  with  the 
a s s i g nme  n t . 

ASSIGNED  TASKS:  Identification  of  the  specific  tasks  to  be 

p e r f o rme  d as  part  of  this  h ome  wo  r k a s s i g nme  n t • 


STANDARDIZED  HCMEWORK  ASSIGNMENTS  ANSWER  KEY 
TEMPLATE 


ASSIGNED  TASKS : Reiteration  of  the  specific  tasks  to  be 

performed  as  part  of  this  homework  assignment. 


ANSWERS: 


Statement  of  correct  answers  to  each  assigned 
t ask/que  s t ion . 
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STANDARDIZED  USAGE  ASSIGhMENTS  TEMPLATE 


LEARNING  OBJECTIVES:  Textual  description  of  the  motivation  for 

performing  this  RECON  usage  assignment  and  the 
learning  objectives  associated  with  the 
a s s i g nme  n t . 


ASSIGNED  TASKS:  Identification  of  the  specific  tasks  to  be 

performed  using  RECON  as  part  of  this  usage 
a s s i g nme  n t . 


STANDARDIZED  USAGE  ASSIGNVIENTS  .ANSWER  KEY  TEMPLATE 

ASSIGNED  TASKS : Reiteration  of  the  specific  tasks  to  be  perfomed 

using  RECON  as  part  of  this  usage  assignment. 

ANSWERS : For  each  assigned  task,  the  full  text  of  a series 

ofuser/ system  RECON  interactions  which  results  in 
the  correct  answer(s)  to  that  task. 


STANDARDIZED  EXAMINATION  TEMPLATE 


BASIC  CONTROL  DATA: 

dat a , 
etc.) 
book , 


Identification  of  basic  examination  control 
type  of  examination  (midterm,  final, 
format  of  examination  (open  book,  closed 
etc.),  duration  of  examination,  etc. 


LESSON  IDENTIFICATION:  Identification  of  the  course  lesson(s) 

relevant  to  each  question  on  the  examination,  to 
ensure  coverage  of  the  examination  across  all 
lessons  comprising  the  course. 


QUESTIONS  : 


Statement  of  the  questions  comprising  the 
examina t ion . 
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STANDARDIZED  EXAMINATION  ANSWER  KEY  TIMPLATE 


BASIC  CONTROL  DATA:  Identification  of  basic  examination  control 

data  (as  above ) . 


QUESTIONS:  Reiteration  of  the  questions  comprising  the 

examina  t i on . 

ANSWERS : Statement  of  correct  answers  to  each  question. 


VISUALS  OBJECTIVES  / GUIDELINES 


(1)  The  collection  of  course  visuals  will  represent  a complete 
and  comprehensive  presentation  of  the  topical  areas  defined 
within  the  course  syllabus. 

(2)  The  collection  of  course  visuals  will  provide  the  framework 
whereby  a qualified  instructor  can  effectively  teach  the 
course  utilizing  the  associated  course  syllabus,  lesson 
plans , etc . 


(3)  The  collection  of  course  visuals  will  provide  the 

information  necessary  to  enable  a conscientious  student  to 
obtain  a co 1 1 ege- 1 e ve 1 understanding  of  the  course  material 
and  to  demonstrate  this  understanding  as  evidenced  by 
acceptable  performance  on  the  course  assignments  and 

examina t ion( s ) . 
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ATTACHMENT  3.2 


COURSE  DEVELOPMENT  PHASE: 
COURSE  DEVELOPMENT  STANDARDS 


FOR  VISUALS  OUTLINES 


I N A S A I 


I NASA  I 


USL/DBMS  NASA/ RECON 
VISUALS  OUTLINE  STANDARDS 


March  27,  1984 


OUTLINE  FORMAT 


Ma jor  section  titles  mus t be  capitalized  and  positioned  to 
start  in  the  left  margin.  Indentation  should  be  five  spaces  at 
each  hierarchical  level.  The  outline  must  be  single  spaced  with 
one  blank  line  between  major  section  and  subsequent  entries,  no 
blank  line  between  subheadings  and  s ub- s ubhe ad i ng s . Line  length 
must  be  standard  runoff  line  length  (.11  65).  An  example  is 
shown  in  the  Appendix,  and  the  reader  should  use  the  example  as  a 
guideline  to  follow  when  preparing  his  or  her  visuals  outline(s) 
for  the  NASA/RECON  project. 


I V I S U A L S I 


1 


I O U T L I N E I 


I N A S A I 


I N A S A I 


FEATURE  ANALYSIS  OF  INTERACTIVE  INTORM^TION  STORAGE  AND  RETRIEVAL 
SYSTEMS 

User  Categorizations 

System  Administrators 
Data  Base  Administrators 
Ap plications  Progr anxne r s 
Inf orma tion  Specialists 
End  Users 
Parametric  Users 

Da  t a Mo  dels 

Hierarchical  Data  Model 
Network  Data  Model 
Relational  Data  Model 
Flat  File  Mode  1 

Logical  Data  Structures 
1 1 em  Level 
Group  Level 
Record  Leve 1 
File  Level 
Data  Base  Level 

Physical  Storage  Structures 

Data  Representation  Considerations 
Da  t a Char ac  teristics  Cons iderations 
Device  Characteristics  Considerations 
Storage  Structuring  and  Accessing  Techniques 

Data  Base  Def ini t ion 
Data  Definition 
Data  Relationships  Definition 
Data  Value  Integrity  Constraints 
Data  Indexing 

Data  Base  Definition  Languages 

Data  Base  Interrogation/Searching 
Basic  Selection  Constructs 
Index  Searching  vs.  Data  File  Searching 
String  Matching  Options 
Exi s tence  Checking 
Compound  Conditions 
Data  Base  Searching  Languages 


1 V I S U A L S 1 


2 


I OUTLINE  I 


I N A S A 1 


I N A S A I 


Data  Base  Report  Generation 

Online  vs.  Offline  Report  Generation 
System  Default  Report  Formats 
Us e r-De f i ne d Report  Formats 
Alternate  Output  Formats 
Report  Generation  Languages 

Data  Base  Update 

Update  Operations 
Update  Modes 
Update  Data  Formats 
Update  History  Files 
Update  Utilities 
Update  Access  Control 
Data  Base  Update  Languages 

Data  Base  Redefinition 

Logical  Data  Structure  Redefinition 
Physical  Storage  Structure  Redefinition 
Redefinition  Facilities 
Data  Base  Redefinition  Languages 

Admi nistrative  Functions 

System  Administrator  Functions 
Data  Base  Administrator  Functions 

Data  Base  Security  Considerations 
Authent i ca  t i on 
Author i za  t i on 

Privacy/Security  Transfo rma t i ons 
Security  Logging 

Performance  Measurement  and  Evaluation 

System  Execution  Efficiency  Orientations 
User  I n t e r f a c e / I nt e r a c t i on  Orientations 
PME  Tools  and  Techniques 
Privacy  Considerations 


BIBLIOGRAPHIC  DATA  BASE  DESIGN 

Bibliographic  Data  Items/Fields 

Bibliographic  Record  Formats 

Document  Files 

Index  Files 

Thesaurus  Files 

Sample  Search  Files 

User  Profile  Files 
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I N A S A I 


BIBLIOGRAPHIC  FILE  STRUCTURES 

Linear  File  Organizations 

List  Structured  File  Organizations 
Mu  1 1 i -L ist  Files 
Inverted  Files 

/ 

Clustered  File  Organizations 
Cluster  Gene r a t ion 
Cluster  De finition 
Cluster  Searching 


VOCABULARY  CONTROL 

Controlled  Vocabularies 

Pr  e-Cont  rolled  Vocabularies 
Post “Con t rolled  Voc  abu 1 a r i e s 

Free  Text  Approaches 

Thesaurus  Support 
Broader  Terms 
Narrower  Terms 
Synonyms 
Abbreviat ions 
Related  Terms 


BIBLIOGRAPHIC  DATA  BASE  SEARCHING 

Types/Levels  of  Search  Languages 

Procedural , Host-Language-Based  Languages 
Self-Contained,  Structured  Query  Languages 
Procedure  Definition  and  Invocation  Languages 
Interactive , Prompt ing-Or iented  Languages 
Batch,  Forms -Or i ent ed  Languages 
Interactive , Forms -Or iented  Languages 
List/Menu  Selection  Languages 
Restricted  Natural  Languages 
Unrestricted  Natural  Languages 
Integrated  Combinations  of  the  Above 

Search  Formulation  Features 
Search  Field  Control 
Single  Term  Searching 
Phrase  Searching 
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I O U T L I N E I 


I N A S A I 


I N A S A I 


Term  Proximity  Searching 
Term  Range  Searching 

Root  Se ar ch i ng / Suf f i X Strip/Prefix  Strip  Searching 

Substring  Searching 

Dictionary  Searching 

The  saurus  Searching 

Relational  Operation  Usage 

Logical  (Boolean)  Operation  Usage 

Request  Sets/Search  Sets 

Search  Profiles/Saved  Search  Strategies 
Search  Revi ew 

Output  Generation  Features 

On 1 i ne /Of f 1 i ne  Output  Generation 

Pre -Defined  Output  Formats 

User-Defined  Output  Formats 

Rapid  Scan 

Expanding 

Hi ghl i ght ing 

Sorting 

Ranking 

I n s t r uc t i ona 1 /Di agno s t i c Features 
Online  System  Documentation 
Online  Data  Base  Documentation 
Online  Training 
Error  Diagnostic  Facilities 
S amp le  Searches 
Search  Logic  Tracing 


ADDITIONAL  IS&R  APPLICATION  AREAS 

Selective  Dissemination  of  Information  (SDI)  Systems 
Current  Awareness  Systems 
Support  For  Personal  Files 

Interfaces  With  Document  Delivery  Systems 


IS&R  PERFORMANCE  MEASUREMENT  AND  EVALUATION 

Phases  of  the  PME  Life  Cycle 

Identification  of  Generic  Evaluation  Objectives 
Identification  of  Detailed  Measurement  Parameters 
Selection  of  Me  a s u r erne  n t Me  c h a n i sms 
Identification  of  Required  Data  Analyses 
Design/Conduct  of  Data  Collection  Experiments 
Conduct  of  Data  Ana ly s i s /Eva  1 ua t i on  Activities 


and 
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Identification  of  Desired  Improvement s /Enhanc ement s 
Implementation  of  Identified  Enhancements 
Repetition  of  Cycle  a?  Dictated  by  Objectives 

Traditional,  Obtrusive  User  Monitoring 
Controlled  Usage  Experiments 
Use  of  Human  Subjects 
Subjective  User  Assessments 
Recall  and  Precision  Analysis 
Failure  Analysis 
Data  Base  Coverage  Analysis 


Advanced,  Unobtrusive  User  Monitoring 

Qua s i -Con t r o 1 1 e d Usage  Experiments 
Unobtrusive  Software  Monitoring  Facilities 
System  Usage  Profile  and  Data  Base  Usage  Profile 
An  a 1 y s i s 
Timing  Analysis 

User  Error  and  Error  Recovery  An  a 1 y s i s 
Direct  and  Surrogate  Measures  of  User  Success 


Automated  Statistical  Data  Analysis 
Trend  Ana ly s i s /Pr o j e c t i on  Analysis 


FUTURE  INFORMATION  STORAGE  AND  RETRIEVAL  SYSTEMS 


Assessment  of  Current  Stat e-of-the-Ar t 
Identification  of  Current  Research  Trends 


Projection  of  Future  Sy s t em  Capab i 1 i t i e s 
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COURSE  DEVELOPMENT  PHASE: 
COURSE  DEVELOPMENT  STANDARDS 


FOR  VISUALS 
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VISUALS  DEVELOPMENT  STANDARDS 
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Computer  Science  Department 
University  of  Southwestern  Louisiana 
P.  O.  Box  44330 
Lafayette,  Louisiana  70504 
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USL/DBMS  NASA/RECX)N 
VISUALS  DEVELOPMENT  STANDARDS 


The  purpose  of  this  document  is  to  establish  the  set  of 
standards  for  the  USL/DBMS  NASA/RECON  visuals  development 
activity  in  order  to  ma intain  a consistent  fo rma t for  the 
visuals  . 

The  set  of  visuals  submitted  should  consist  of  the 
foil owi  ng : 

COVER  PAGE 

Each  set  of  visuals  should  have  a title  cover  page  for  the 
topic  covered  in  the  visuals.  The  cover  page  for  the  set  of 
visuals  should  have  the  title,  centered,  and  all  in  capital 
letters.  Since  the  final  product  of  each  set  of  visuals  will  be 
printed  on  the  laser  printer  with  a large  type  font,  you  must 
restrict  the  number  of  characters  per  line  to  not  more  than 
thirty— five  for  the  title  lines  of  the  cover  page  as  well  as  the 
title  lines  on  each  visual. 
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TABLE  OF  CONTENTS 

After  the  cover  page,  the  next  set  of  pages  must  be  a table 
of  contents  (using  as  many  pages  as  necessary  to  identify  the 
titles  of  every  section  that  will  subsequently  occur  in  the  set 
of  visuals).  The  table  of  contents  must  correspond  to  the 
visuals  outline  with  respect  to  section  titles.  An  example  is 
shown  in  the  Appendix.  Notice  that  the  titles  of  all  sections 
are  included  in  appropriate  upper  and  lower  case.  All  textual 
lines  (i.e.,  all  lines  other  than  title  lines)  on  all  visuals 
must  be  restricted  to  a maximum  of  50  characters  per  line, 
including  leading  blanks  or  indentation.  Your  runoff  segments 
should  use  ”.11  50”. 

SECTION  FORMAT 

The  first  page  of  each  section  must  be  a section  cover  page 
formatted  identically  to  the  visuals  cover  page.  All  subsequent 
visuals  pages  must  have  a descriptive  title  line(s).  All  title 
lines  are  centered  and  capitalized.  If  a visual  is  a 
continuation  of  the  previous  visual,  then  the  visual  title  line 
should  be  the  same  as  that  of  the  previous  visual  with  a 
following  "(cont’d)”  entry. 
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There  should  never  be  more  than  twenty  lines  per  visual. 
Divide  the  contents  of  each  visual  carefully.  Make  your  best 
judgement  of  where  you  should  break  page  to  the  next  visual 
without  disrupting  the  flow  of  continuity,  or,  on  the  other  hand, 
without  trying  to  force  everything  onto  one  visual. 

The  level  of  detail  presented  in  each  visual  should  be 
considered  carefully.  Avoid  lengthy  descriptions  or  wordy 
presentations  of  concepts.  Keep  descriptions  concise  and 
compact.  List  your  topics  out  one  by  one  without  clustering  them 
into  paragraphs.  Keep  your  audience  in  mind  when  you  define  the 
level  of  details  or  abstractions.  Avoid  duplication  of  material 
that  is  to  be  presented  in  another  section.  Remember  that  a 
picture  is  worth  a thousand  words.  Use  Graphics,  Diagrams, 
Charts,  Drawings,  Cartoons,  etc.  to  catch  attention  and  for 
aesthetic  purposes.  Provide  as  many  examples  as  possible  to 
illustrate  the  concepts  in  a clear  and  precise  manner. 

The  rule  for  indentation  of  lines  is  as  follows.  Generally, 
each  hierarchical  level  of  concepts  should  be  indented  five 
spaces  • Th is  can  be  best  illustrated  in  the  ex  amp le  presented  in 
the  Appendix  of  this  document.  This  scheme  will  work  up  to  three 
hierarchical  levels  of  indentation.  After  three  levels,  you  will 
run  out  of  space  (with  a line  length  of  50),  unless  each  line  is 
only  a few  words  long.  If  the  material  absolutely  requires  more 
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than  three  hierarchical  levels,  you  should  determine  the 
appropiate  indentation  scheme,  for  example,  two  space  indentation 
if  absolutly  necessary. 

The  format  of  capitalization  and  line  spacing  should  be 
observed  from  the  example  given  in  the  Appendix.  You  must  keep 
in  mind  that  the  visuals  will  be  produced  on  the  laser  printer 
with  a considerably  larger  type  font  than  that  on  the  line 
printer.  Doub le  spacing  is  the  mi n imum  spacing  be  tween  two  lines 
(do  not  use  si ng le  spacing). 

Do  not  use  page  numbering,  headers,  footers,  or  any  other 
special  runoff  facilities.  All  of  these  will  be  supplied  later 
by  a tailored  post-processor  to  ensure  consistency  across  all 
sets  of  visuals. 

For  each  visual  that  naturally  provides  a hook  to  a 
system-specific  example  or  d i s c i p 1 i ne- s pe c i f i c example,  include, 
as  the  last  line(s)  on  the  visual,  either  or  both  of  the 
f ol lowing  statement : 

HOOK  TO  SYSTEM-SPECIFIC  EXAMPLE 
HOOK  TO  DISCIPLINE-SPECIFIC  EXAMPLE 
These  statements  must  not  be  ’’hard-coded”  in  your  runoff  segments 
but  rather  inserted  via  use  of  runoff  ”.if”  conmands.  The  insert 
files  can  be  found  in  the  ” > udd >CMPS669C2 >VISUALS”  directory. 


1 V I S U A L S 1 


5 


I STANDARDS  I 


I N A S A I 


I NASA  I 


Th  e i r n ame  s are: 

’’NASA.V.  sys  tem^exampl  e . runoff  ” 
"NASA  .V . d i s c i p 1 examp  1 e . runo  f f ” . 
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* 


* 


DISTRIBUTION  CONSIDERATIONS 
IN 


DISTRIBUTED  DATA  PROCESSING 


DISTRIBUTION  CONSIDERATIONS 
IN 

DISTRIBUTED  DATA  PROCESSING 


TABLE  OF  CONTENTS 


Considerations  for  Distribution  of  Data 


Considerations  for  Distribution  of  DBMS  Functions 


CONSIDERATIONS  FOR  DISTRIBUTION  OF  DATA 


Da  t a 


« * « 


« « « 


♦ » * 


« « « 


« « « 


« * « 


« « « 


« « « 


« « « 


Base  Size  and  Structuring  : 

Number  of  records  (logical  and  Physical) 

Average  number  of  data  item  values  per 
record 

Number  of  key  items 

Number  of  key  values  per  key  item 

Minimum,  maximum,  and  average  record 
length 

Minimmn,  maximum,  and  average  data  item 
length  by  data  it  em 

Minimum,  maximum,  and  average  key  value 
length  by  key  item 

Total  size  of  data  files  by  data  item 
and  by  record-level 

Total  size  of  indices  by  key  item(s) 


« « « 


Total  size  of  directories 


CX)NS I DERAT IONS  FOR  DISTRIBUTION  OF  DATA  (cont’d) 


« « « 


Relative  Frequency  of  Data  Base  Activities  : 

***  Generic  level  : 

***  Search  / Retrieval  activity 
Output  activity 
♦♦♦  Maintenance  activity 

Detail  1 eve  1 : 

***  Search  / Retrieval  activity  by 

search  type  by  data  item  / key  item 
***  Output  activity  by  output  type  by 
data  item 

Maintenance  activity  by  Add  / 

Delete  / Update  type  by  data  item 
***  Search  / Retrieval,  output,  and 

ma intenance  activity  by  r e c o r d- level 
oper a t ions 

Relative  Complexity  of  Data  Base  Activities 


Relative  Order  of  Activity  Execution 


CONSIDERATIONS  FOR  DISTRIBUTION  OF  DATA  (cont’d) 


Statistics  Char ac  t erizing  Activity  Execution 
***  CPU  t ime  duration 

***  I/O  time  duration  or  paging  activity 
Real  time  duration 

***  Other  resource  utilization  requir  ement  s 

And , of  course,  Statistics  characterizi ng  the 

storage  devices  and  processing 
capabilities  ava ilable  at  each 


node  . 


* CONSIDERATIONS  * 

* FOR  ♦ 

* DISTRIBUTION  OF  DBMS  FUNCTIONS  ♦ 


**tt**********t****t**tt***********t* 


CONSIDERATIONS  FOR  DISTRIBUTION  OF  DBMS  FUNCTIONS 


* » « 


* t* 


**  * 


Size  of  System  Code,  by  Module 

Size  of  Required  System  Buff ers , by  Module 

Relative  Frequency  of  Execution  of  System 
Code,  by  Module 

Statistics  Characterizing  Execution  of 
System  Code,  by  Module  : 

* * * CPU  t ime  duration 

***  I/O  time  duration  or  pnging  activity 
***  Real  time  duration 

***  Other  resource  utilization  requi r ement  s 

Chrono logical  and  Parallel  Ordering  of 
Module  Execut ions 


***  Calling  Sequence  of  Module  Executions 


I NASA  I 


I NASA  I 


VISUALS  DEVELOPMENT  STANDARDS 
PHASE  II 


S 
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General  Guidelines 

Do  not  use  complete  sentences  as  part  of  the  visuals,  some 
examples  do  require  this  construction  but  the  plan  is  to 
ma ke  the  visuals  skeletal. 

Use  specific  terms  rather  than  general  ones  where  possible, 
if  a t e rm  is  tec  hn ical  or  obscure,  refer  it  to  Instructor 
Notes  WITH  m APPROPRIATE  DEFINITION. 

Abbrevi at i ons 

The  only  acceptable  abbreviation  is  IS&R  for  Information 
Storage  and  Retrieval  System.  Other  abbreviations  will  not 
be  used;  this  is  the  customary  standard  for  technical 
wr  i t ing . 

I ndent  a t ion 

The  standard  indentation  is  5 spaces  per  level. 

Title 

Please  use  ”.sp  16”  to  space  the  star  boxes  at  the  start  of 
each  sect! on . 

Capi tal i z ing 

Each  word  will  begin  with  a capital  letter  except  minor 
prepositions  and  articles. 
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I STAND  A R D S I 


I NASA  I 


I NASA  I 


Example:  Pointers  to  Documents 


Stars 

Each  topic  line  will  be  marked  by  three  stars  followed  by 
two  spaces  . 

Example:  **»  Like  This 
Parentheses 

No  parenthetical  expressions  will  be  used;  when  this 
temptation  strikes  either 

1-  Use  s ub— c a t e g o r i e s , or 

2.  Migrate  the  material  to  Instructor  Notes. 


Runo  f f 

All  material  is  to  be  written  using  runoff;  do  not  attempt 
to  indent  without  using  this  facility.  This  leads  to 
problems  when  editing  is  necessary  since  your  carefully 
measured  lines  will  change  shape. 

A hint;  When  formatting  tables,  etc.  which  require  the 
material  to  be  lined  up  in  columns  use  the  ”.tr  ” 
instruction  and  insert  the  when  a space  is  needed,  this 
prevents  runoff  from  formatting  your  material. 


I V I S U A L S I 
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I STANDARDS  1 


I NASA  I 


I NASA  I 


Spe 1 1 i ng 

Please  make  use  of  the  runoff  wordlist  facility 
your  spelling,  the  comnand  is  ”ec 
< segment name  > .runoff  ” . 


to  check 
pot  1 uck  >wl 


I V I S U A L S I 
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I STANDARDS  I 


ATTACHMENT  3.4 


COURSE  DEVELOPMENT  PHASE: 

FIRST  DRAFT  OF  PROPOSED  INTEGRATED 


OUTLINE  OF  COURSE  VISUALS 


I NASA  I 


I N A S A I 


****♦***»****♦**»******«*»*«*»**»»»»****«»»******»*»»*»«* 


NASA  / RECON 

COURSE  DEVELOPMENT  SERIES 


FIRST  DRAFT; 

PROPOSED  INTEGRATED  OUTLINE  OF 
COURSE  VISUALS 


The  NA.SA/RECX)N  Course  Development  Series  contains  a collection  of 
draft  course  development  deliverables  representing  draft  results 
of  the  educational  course  development  activities  being  conducted 
pursuant  to  the  specifications  of  National  Aeronautics  and  Space 
Administration  Contract  Number  NASW--3846, 

The  entries  within  this  series  are  in  "draft”  form;  they 
represent  work  in  progress  and  work  in  various  stages  of 
revision.  As  such,  they  should  not  be  construed  as  final 
products  nor  should  they  be  viewed  as  material  for  widespread 
distribution.  All  entries  within  this  series  will  be  subjected  to 
multiple  development  phase  revisions,  to  course  pilot 
administration,  and  to  final  course  pilot  evaluation  and  final 
revision  prior  to  being  distributed  as  final  course  deliverables. 


For  more  information,  contact: 
Wayne  D.  Dominick 
Edi tor 

NASA/RECON  Course  Development  Series 
Computer  Science  Department 
University  of  Southwestern  Louisiana 
P.  O.  Box  44330 
Lafayette,  Louisiana  70504 
(318)  231-6308 


I COURSE  I 


I DEVELOPMENT  I 


M^NUAL  VERSUS  AUTCM^TED  RESEARCH  METHODS 


Conventional  Research  Tools 
Ref erence  Tool s 
The  Card  Catalogue 
Library  Organization 

Informat ion  Science 
Manual  System 
Li  brary 

Computerized  System 
Data  Base 

Manual  Search  vs.  Computerized  Search 
Finding  Indices 
Coord i na  t i ng 
Samp  ling 
Output 
Re V i ew 

Advantages  of  Online  Search 
Disadvantages  of  Online  Search 
Information  Storage  and  Retrieval 
Producers 
Proces  sor s 

Data  Base  Compost  ion 
Document  File 
Index  Files 

FEATURE  ANALYSIS  OF  INTERACTIVE  INFORMATION  STORAGE  AND  RETRIEVAL 
SYSTEMS 

User  Cat  ego ri zat ion 
Rati ona 1 e 

Differing  User  Requirements 

System  Orientations  Toward  Multiple  User  Categories 

Ca  tegori zat ion  Pa  r ame  t e r s 
User  Background 
User  Experience 

Pres  ent  Sy s t em 
Other  Sy s t ems 
General  Computer 
User  Job  Functions 

Category  Definition 
Func t ional 

System  Administrators 
Data  Base  Admin i strators 
Appl ications  Programners 
Informat ion  Specialists 
End  Users 
Parametric  Users 
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Casual  Users 


Da  t a Mode  1 s 

Basic  Concepts  of  Data  Models 

Hierarchical  Data  Model 

Network  Data  Model 

Relational  Data  Model 

Flat  File  Mode  1 

Similarities  and  Differences  Between  Data  Models 
Lo gical  Data  Structures 

Logical  Data  Structure  vs  Physical  Storage  Structure 
Logical  Data  Structure  Concepts 
Physical  Storage  Structure  Concepts 

Data  Structure  Levels 
1 1 em  Leve  1 
Group  Level 
Record  Level 
File  Level 
Data  Base  Level 

Data  Structure  Hierarchy 
Physical  Storage  Structures 

Da ta  Representation 
Word  Size 
Wo  r d F o rma  t 

Char ac t er  Representation 
Nume ric  Representation 
Null  Value  Representation 

Data  Characteristics 
Data  Types 
Value  Length 
Value  Range 

Device  Char ac t eristics 
Access  Mode 
Addr e s sab i 1 i ty 

Storage  Structuring  Techniques 
Sequent ial  Structure 
Indexed  Structure 
Linked  List  Structure 
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Tree  Structure 
Ne  twork  Structure 


Accessing  Techniques 

Sequential  Search 

Indexed  or  Linked  List  Search 

Direct  Acce  s s ing 

Simple  Direct  Method 
Hashing  Method 

Da  t a Ba  s e De  finition 

Data  Non- redundancy 

Data  Consistency 

Data  Independence 

Schema  Definition 

Subschema  Definition 
File  Definition 
Record  De  finition 

Data  Indexing 

Da  t a Base  De  finition  Language  s 
Da t a Ba se  Interrogati on/Sea r chi ng 

The  Searching  Cycle 
Logging  In 
Selecting  Files 
Entering  Conmands 
Printing  Results 
Logging  Out 

Ba  sic  Selection  Cons  t rue  t s 
Relational  Expressions 
Selecting  Te rms 
Combining  Terms 
Creating  A Search  Profile 
Polishing  The  Process 
Retrieving  Te  rms 

Index  Searching  vs.  Free  Text  Searching 
Controlled  Vocabulary 
Uncont ro lied  Vocabulary 

String  Matching  Options 

Phrase  Searching  in  Diet  ionary 
Exact  Match 
Substring  Match 
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Root  Match 

Universal  Match  Character 

Exi stence  Checking 
Term  Ex i s t ence 
Null  Terms 

Displaying  Dictionary 

Log  ical  Combinat ions 
Boo  lean  Log i c 
Othe  r Log i c s 

Data  Base  Searching  Languages 
Historical  Overvi  ew 
Major  IS  & R Systems 
Compar i son  of  Sy s t ems 

Data  Base  Report  Generation 

System  Default  Report  Format 

User-Defined  Report  Formats 
Report  Content 
Data  Editing  Formats 
User  Created  Formats  Library 

Alternate  Output  Formats 
Binary  Output  Files 
Computer  Output  to  Microfilm 
Graph ical  Displays 

Report  Generation  Languages 

Data  Base  Update 

Update  Operations 

Update  Mode 

Update  Data  Formats 

Update  History  Files 

Update  Access  Control 

Textual  vs.  Numerical  Data  Base  Update 
Data  Base  Redefinition 

Need  for  Data  Base  Redefinition 
Logical  Data  Structure  Redefinition 
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Physical  Storage  Structure  Redefinition 

Data  Base  Redefinition  Languages 

Admin i strative  Func  t i pns 

System  Administrator  Functions 

The  Information  System  Life  Cycle 

System  Administration  Within  This  Life  Cycle 

Data  Base  Administration  Functions 
The  Data  Base  Life  Cycle 

Data  Base  Admini s t ra t i on  Wi  thin  This  Life  Cycle 
Data  Base  Security  Considerations 
Authent i ca t i on 

Software  Authentication  Techniques 
Physical  Authentication  Techniques 

Author i za t i on 

Authorization  Methods 

Security  Logging 

Simple  Logging 
Threat  Moni tor ing 

Real-Time  Threat  Monitoring 
Non-Rea  1 -Time  Threat  Monitoring 

Security/Pr i vacy  Trans  f orma t ions 

Methods  of  Security/Privacy  Transformations 

Performance  Measurement  and  Evaluation 

User  Interface/Interaction  Or ientations 

Support  for  User-Oriented  Cost-Perf ormance- 

Benef i t Ana  lysis 

Me  a s u r erne  n t Par  ame  t e r s 

System  Execution  Effeciency  Orientations 
Levels  of  Orientation 

Logical  Data  Base  Design  Level 
Logical  Data  Base  Organization  Level 
Physical  Storage  Organization  Level 
Underlying  Machine  Organization  Level 
Me  a s u r erne  n t Par  ame  t e r s 

Tools  and  Techniques 
Moni tors 

Software  Monitors 
Hardware  and  Firravare  Monitors 
Nbde  1 s 

Analytical  Model 
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Simulation  Model 
Queue ing  Mode  1 

Benchmarks  and  Synthetic  Programs 

User  Questionnaires,  Evaluation  Forms,  Checklists 


BIBLIOGRAPHIC  DATA  BASE  DESIGN 

Bibliographic  Data  Base  Levels 
1 1 em 
Group 
Record 
File 

Data  Base 

File  Design  Considerations 

Bibliographic  Data  Types 
Record  Design 
Data  Usage  and  Updating 
File  Structures 

Type  of  Files 

Do  c ume  n t Files 
Index  Files 
Thesaurus  Files 
User  Profile  Files 
Sample  Search  Files 


BIBLIOGRAPHIC  FILE  STRUCTURE 

Linear  File  Organizations 

Unordered  Sequential  File 
Ordered  Sequential  File 

Indexed  File  Organizations 

Indexed  Sequential  File 
Indexed  Non-sequent ia 1 File 

List  Structured  File  Organizations 
Singly  Linked  List 
Doubly  Linked  List 
Inverted  List  File 
Multi-list  vs.  Inverted  List 

Tree  and  Network  File  Organizations 
Binary  Tree  and  Balanced  Tree 
Simple  Network  and  Complex  Network 

Clustered  File  Organizations 
Cluster  Definition 
Cluster  Genera t ion 
Classification 
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Co-relation  Matrix 
Reduction 
Cluster  Search 

Cluster  Hierarchy 
Top-down  and  Bottom-up  Search 
Clustering  Tradeoffs 
Advantage  s 
Di  sadvantage  s 


VOCABULARY  CONTROL 

Control  led  Vocabularies 

List  of  Index-Search  Terms 
Consistent  Indexing 
Search-Index  Correspondence 
Compound  Concepts 

Pre-Coord inat ion 
Post -Coord i na  t i on 

Free  Text  Appr oache  s 

No  Index-Search  List 
Terms  Taken  Directly  From  Text 
Advantage  s 
Di  sadvantage  s 

Thesaurus  Support 

Basic  Concepts  of  Thesauri 
Roge  t 

List  of  Synonyms 

Choice  of  Alternative  Words 

IS&R 

List  of  Descriptors  - Subject  Headings 
Directs  to  Postable  Terms 
The  saurus  Utilization 

Synonyms  and  Near  Synonyms 
Mi  s spe 1 1 ings 
Abbreviat ions 
Homographs 
Search  En 1 a r g erne  n t 
Broader  Terms 
Related  Terms 
Search  Conf inement 
Narrower  Terms 
Related  Terms 


BIBLICXxRAPHIC  DATA  BASE  SEARCHING 

Types  / Levels  of  Search  Languages 

Brief  Review  of  Bibliographic  IS&R  System  Languages 
Information  Content 
Dynami  c s 
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Bibliographic  Data  Base  Searching 

Rationale  for  Hierarchy  of  Search  Languages 
User  Needs 
Language  Capabilities 

Levels  of  Data  Base  Search  Languages 
Search  Languages 

Procedural,  Ho s t - 1 anguag e-Ba s e d Languages 
Cha  r ac  teristics 
Usage 

Self-Contained,  Structured  Query  Languages 
Cha r ac  t er i sties 
Usage 

Procedure  Definition  And  Invocation  Languages 
Char ac  t er i sties 
Usage 

Interactive,  Prompt i ng-Or iented  Languages 
Char a c teristics 
Usage 

Batch,  Forms -Or i ent ed  Languages 
Char ac  t eristics 
Usage 

Interactive,  Forms  -Or iented  Languages 
Char ac  t eristics 
Usage 

List/Menu  Selection  Languages 
Character! sties 
Usage 

Restricted  Natural  Languages 
Char ac  teristics 
Usage 

Unrestricted  Natural  Languages 
Char ac  teristics 
Usage 

Integrated  Combinations  of  Data  Base  Search  Languages 

Search  Formulation  Features 
Search  Field  Control 

Text  Fields 
Title 

Series  Title 
Ab  s t r a c t 
Subject  Heading 
Publ i sher 
Conf  er ence 

Non-Text  Fields 
Da  t e 
Author 
Language 
Issue  Numb  e r 
Library  Holding  Data 
Single  Term  Searching 

Collective  Fields 
Text 
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Non-Text 

Individual  Fields 
S topwords 

Too  Frequent 

Ignored  for  Indexing  and  Searching 
Phr  a se  Searching 

Natural  Order 
I nve r ted  Order 
Term  Proximity  Searching 
Word  Pos i t i on 
Relative  Position 
Term  Range  Searching 
Limi  ting  Search 
Limi  t s on  a Nume  ric  Field 
Update  Fields 
Root  Searching 

Select  The  S t em  of  Each  Te  rm 
Reduce  Index  Size 

Retrieve  More  Potentially  Relevant  Items 
Suf fix  Strip 

List  of  Suf  fixes 
Verbs,  Adverbs,  Plural  Forms 
Pref ix  Strip 
Substring  Searching 
Word  Truncation 

Universal  Character 
Truncation  Unlimited 
Using  Inverted  Files 
Fragmented  Words 
Dictionary  Searching 
Abstract  Field 
Oldest  Ent  r i e s 
The  saurus  Search 
Ma  j o r Te  rms 
Minor  Terms 

Dictionary  Searching  Aids 
The  saurus  Searching 

Search  En 1 a r g erne  n t 
Broader  Terms 
Related  Te  rms 
Search  Restriction 
Narrower  Terms 
Related  Terms 
Searchable  Fields 
Major  Terms 
Minor  Terms 

Subject  Terms  (Combination  of  Both) 
Expansion  Capabilities 
Entry  terms 

A1  phabe t ical  Listing 
Spell ing  Tolerance 
Entry  Vocabulary  Terms 
Thesaurus  Terms 


9 


Relational  Operation  Usage 
Boolean  Logic 

General  Concepts 
Venn  Diagrams 
Opera t ion  Usage 
Limits  of  Logic 
Implicit  Concepts 

Search  Pr of i 1 e s /Saved  Search  Strategies 
One  Time  Search  vs.  Saving  a Search 
Saved  Search 

Current  Awareness 
SDI 

Stored  Search  Techniques 

The  Cycle  of  Stored  Search 

Pre-Saving 

Pos  t-Saving 

Request  Sets  / Search  Sets 
Results  of  Queries 
Au  t oma  tic 
Manua I 

Incorporate  in  Subsequent  Queries 
System  Initiated  - All  Session  Sets 
User  Initiated  - Keep  Set 
Search  Expression 

Combines  Commands 
Search  Review 

Display  Sumnary  of  Active  Request  Sets 
Number  of  Retrievals  Per  Set 
Query  Which  Created  Set 
Set  Status 
Current  Status 
Session  Info rma t i on 
Date 
Time 

File  Co  1 1 e c t i on 

Format  Specification 

User  Selected  Options/Parameters 

Output  Generation  Features 
Search  Review 

Online  vs.  Offline  Output  Generation 
Online  Output  Generation 
Offline  Output  Generation 
Comparat i ve  Ana  lysis 
Predefined  Output  Formats 
User— Defined  Output  Formats 
Report  Content 
Data  Editing  Formats 
User  Created  Formats  Library 
Additional  Output  Generation  Features 
Rapid  Scan 
Expanding 
Highl ight ing 
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Sorting 

Ranking 

Printed  Index  Generation 

Key  Word  In  Context  (KWIC)  Index 
Key  Word  Out  of  Context  (KWX!)  Index 

Instructional  and  Diagnostic  Features 
User  Guide 

Printed  Users  Manual 
On-line  System  Documentation 

Brief  Description  of  all  System  Conmands 
Brief  Description  of  all  Error  Diagnostic  Messages 
On-line  Data  Base  Documentation 

Brief  Description  of  Data  Base 
On-line  Training 

Provision  of  Sy s t em  Tu t or i a 1 s for  the  New  User 
Li ve-he Ip 

Accessibility  to  System  Consultant 
Error  Diagnostic  Facilities 

Pre-execution  Error  Diagnostic  Messages 
Execut i on-t  ime  Error  Diagnostic  Messages 
Sample  Searches 

Pre-stored  Sample  Se a r che s /Te ach i ng  by  Analogy 
Search  Logic  Tracing 
Monitor  Log 

System-maintained  Record  of  User’s  Interactions 
Rati ona 1 e 

Feedback  to  the  Sy s t em  De  s i gne r s 
Foundations  for  System  Evaluation 


ADDITIONAL  IS&R  APPLICATION  AREAS 

Selective  Dissemination  of  Information  (SDI)  Systems 

Maintains  Bibliographic  Data  of  Specific  Discipline 

Personal  Service 

Machine  Aided  Information 

User  Profiles  Constructed 

Profiles  Periodically  Modified 

Search  Strategy 

Automatic  Feedback 

Support  for  Personal  Files 

Files  for  Specific  Projects 

Small  Number  of  References 

User  Specification  of  Data  Base  Features 

Combination  of  Bibliographic  and  Data  Management 

Charac  t eristics 

Combined  Retrieval  Systems 

Interconnection  of  Information  Facilities 
Conmon  Interface 
Conmon  Conxnand  Language 
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User  Freed  from  Different  Comnand  Languages 

Personal  Compu t ing  Envi ronment  s 

Personal  Computer  Access  to  Remote  IS&R  System 
Data  Retrieved  into  Personal  Compute r Storage 
Cha  racteristics 
Func  t i ons 
Users 

Pre stored  Procedures 
Security 

Interfaces  with  Document  Delivery  Systems 
Microform  storage 

No  Rewriting  / No  Erasing 
Paper  Copy  Produced  on  Demand 
Random  Acce  s s 

Da  t a Vi  ewed  on  Special  Reading  Equ i pment 
Video  Disks 

Large  Data  Stored 
No  Rewriting 
Ma  i 1 ed  to  Us  e r s 
Pitfalls 


IS&R  PERFORMANCE  MEASUREMENT  AND  EVALUATION 

Phases  of  the  PME  Life  Cycle 
Ten  Phases 

Identify  Generic  Evaluation  Objectives 
Identify  Specific  Eva  1 ua t i on  Ob jectives 
I dent i f y De  t a i led  Me  a s ur  ement  Par  ame  t e r s 
Select  Evaluation  Mechanisms 
Identify  Eva  1 ua t i on  Too  1 s 

Identify  Data  Analysis  and  Data  Presentation  Tools 
Design  and  Conduct  Data  Collection  Experiments 
Identify  De  sired  Improvement  s /Enhanc  ement  s 
Imp  1 erne  nt  Identified  Enh  a n c erne  n t s 
Repeat  Cy c le  as  Dictated  by  Ob  jectives 
Categorizations  of  Gene r i c /Spe c i f i c Objectives 
Measurement  Par  ame  ters  at  Different  Levels 
User  Level 

Logical  Data  Base  Design  Level 
Logical  Data  Base  Organization  Level 
Physical  Storage  Organization  Level 
Underlying  Machine  Level 
Types  of  Parameters 

Ob  j ect ive  Parameters 
Sub j ec  t i ve  Par  ame  ters 
Selection  of  Evaluation  Mechanisms 
Evaluation  Tools 
Mode  1 s 

Analytic  Models 
Simulation  Models 
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Queue ing  Mode  1 s 
Abstract  Data-Flow  Models 
Algorithm  Analysis 
Benchmarks  and  Synthetic  Programs 
Ha  r dwa  r e / F i rnwa  r e Mo  n i t o r s 
Software  Monitors 

Questionnaires,  Evaluation  Forms,  Checklists, 
User  Conments,  Personal  Observation 
Data  Analysis  Tools 

Frequency  Distributions 
Descriptive  Statistics 
Bivariate  /Mu  Itivariate  Ana  lysis 
Tests  of  Significance 
Regression  Analysis 
Ana  lysis  of  Variance 
Markov  Analysis 
Data  Presentation  Tools 

Graphic  Representations 
Tables  of  Results 
Design  and  Conduct  of  Experiments 
Acting  on  Evaluation  Results 

On-going  Performance  Measurement  and  Evaluation  Cycle 

Traditional  Obtrusive  User  Monitoring 
Basic  Concepts 

User  Apparent 

Interference  with  Interaction 
Controlled  Usage  Experiments 
Design  Dec i s i ons 
Grouping  Subjects 
Control  of  Environment 
Genera  1 i zabi 1 i ty  to  Real  World 
Use  of  Human  Subjects 

Psychological  Considerations 
Variability  Control 
Confidentiality  Considerations 
Subjective  User  Assessments 
Que s t i onna i r e s /Ra t ing s 
Interactive  Conments 
Recall  and  Precision  Analysis 
Recall 

Measures  Completeness  of  Retrieval  Set 
De t e rminab i 1 i ty  Problems 
Pr e c i s i on 

Determines  Relevancy  of  Retrieval  Set 
Determinabi 1 i ty  Problems 
Re c a 1 1 /Pre c i s i on  Inverse  Relationship 
Usefulness  in  Controlled  Experiments 
Failure  Analysis 

Correlation  to  Recall  and  Precision  Analysis 
Analyze  Indexing 
Analyze  User  Search  Strategy 
Feedback  for  System  Improvements 
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Data  Base  Coverage  Analysis 

Compare  Data  Base  Content  to  all  Relevant  Information 
Data  Base  Administrator  Responsibilities 

Advanced  Unobtrusive  User  Monitoring 
Basic  Cone  ep t s 

Transparent  to  User 
No  Interf erence  Wi  th  Interaction 
Qua s i -Con t r o 1 1 e d Usage  Experiments 
Subject  Grouping 
Definition  of  Tasks 
Limi  ted  Control  of  Env i r onme n t 
Unobtrusive  Software  Monitoring  Facilities 
Parame  t e r s 

User  Error  and  Error  Recovery  Data 
Timing  Data 
Retrieval  Logs 
Charac  teristics 

Levels  of  Transparency 
Necessity  of  Validation 
Software  Engineering  Techniques 
Charac  teristics 

Application  to  Data  Base  Systems 
System  Usage  Profile  Analysis 
Par  ame  t e r s 

Conmands  and  Features  Used 
Data  Bases  Utilized 
Patterns  of  Usage 

Identification  of  Typical  Patterns 
Deviations  from  Patterns 
Usage  Analysis 

Determine  User  Proficiency 
Me  a sure  Learnability 
Measure  Usability 
Timing  Analysis 

System  Response  Times 
Time/Cost  Analysis 
Real  Time 
CPU  Time 

User  Response  and  Think  Times 
User  Error  and  Error  Recovery  Analysis 
Limi tat  ions 

Measurement  of  Logical  Errors  Restricted 
Lack  of  Information  on  User  Motivation 
Parameters 

Numb er  of  Errors 
Types  of  Errors 
Context  of  Errors 
Use  of  Help  Conmands 
Recovery 

Decrease  in  Incidence  of  Similar  Errors 
Successful  Subsequent  Searches 
Utilization  of  Results 
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Modi fication  of  Syst  em 
Modification  of  Data  Base 
Future  Design  Decision-Making 


FUTURE  INFORMA.TION  STORAGE  AND  RETRIEVAL  SYSTEMS 

Languages  for  Retrieval 

Conmon  Conmand  Languages 
Natural  Languages 
Special  Cha r ac  t e r Language  s 
Mu  Itiple  Purpose  Language  s 

Alternative  User  Interfaces 
Graphics  Displays 
Graph ics  Input  Devi c e s 
Voice  / Text  Recognition 
TV  and  Video  Interfaces 


PC  Environments 

Intelligent  Te  rmina 1 s 
PC“Ba  sed  Interfaces 
Automat  ed  Hookups 
Multi-System  Access 
Loca 1 Process ing 


Knowl edge  Based  Syst  ems 

Intelligent  Ga  t eway s 
Conmon  Conmand  Languages 
Query  Optimizations 
User  Advising 
Intelligent  Diagnostics 
Knowl edge  Re  pr  e sentations 
F r ame  s 
Ru  1 e s 

Transition  Networks 
Proce  s s ing 

Tradi t i ona 1 

Conme r c ial  Products 

Special  Cases 


Distributed  and  Network  Systems 
Network  Configurations 
Network  Sizes 
Ha  r dwa  r e 
Sof  twar e 

Lo  cal  Da  t a Ba  s e s 

Local  / Remote  Processing 
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ATTACHMENT  3.5 


COURSE  DEVELOPMENT  PHASE: 
FIRST  DRAFT  OF  PROPOSED 


COURSE  VISUALS 


I N A S A I 


I NASA  I 
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NASA  / RECON 

COURSE  DEVELOPMENT  SERIES 


FIRST  DRAFT: 
PROPOSED 
COURSE  VISUALS 


The  NA.SA/RECON  Course  Development  Series  contains  a collection  of 
draft  course  development  deliverables  representing  draft  results 
of  the  educational  course  development  activities  being  conducted 
pursuant  to  the  specifications  of  National  Aeronautics  and  Space 
Administration  Contract  Niunber  NASW-3846. 

The  entries  within  this  series  are  in  "draft”  form;  they 
represent  work  in  progress  and  work  in  various  stages  of 
revision.  As  such,  they  should  not  be  construed  as  final 
products  nor  should  they  be  viewed  as  material  for  widespread 
distribution.  All  entries  within  this  series  will  be  subjected  to 
multiple  development  phase  revisions,  to  course  pilot 
administration,  and  to  final  course  pilot  evaluation  and  final 
revision  prior  to  being  distributed  as  final  course  deliverables. 
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I COURSE  I 


I DEVELOPMENT  1 


CXDURSE  OVERVIHV 


Manual  Versus  Automated  Research  Methods 

Feature  Analysis  of  Interactive  Information 
Storage  and  Retrieval  Systems 

Bibliographic  Data  Base  Design 

Bibliographic  File  Structure 

Vocabulary  Control 

Bibliographic  Data  Base  Searching 

Additional  ISSJl  Application  Areas 

ISSdR  Performance  Measurement  and  Evaluation 

Future  Information  Storage  and  Retrieval 
Systems 


SYSTBVB  APPLICATICMS 


NASA/F 


MANUAL  VS  AUKMATED 
RESEARCH  MEIHXS 


OCNVENTICNAL 
RESEAECH  TOOLS 


ocNVBsrriasiAL  research  tools 


TABLE  OF  OOsTTENrS 


Reference  Tools 


The  Card  Catalogue 


Library  Organization 


REFERENCE  TOOLS 


General  References 

* * * Di ct ionar i es 

* * * W)rd  Meanings 

* • * Elxamples 

The  Oxford  Elnglish  Dictionary 

Acronyms;  Initial  isms  and 
Abbreviations  Dictionay 

* * * Thesaur i 

***  Alternative  Terms 

* * * Synonyms 

* 

***  Eiicyclopedia 

***  Basic  Information 
***  Brief  Articles 

* * * Coverage 

***  General  Knowledge 

* * * Example 

The  Encyclopedia  Brittanica 
***  Specific  Field 

* * * Example 

The  Elncyclopedia 
Science 


of  Comput 


REFEHBSICE  TOOLS  ((XNT’D) 


Periodical  Indices 
* * * Serial  Publications 
***  Current  Literature 
***  Level  of  Coverage 

***  Specific  Subjects 

* * * Examples 

The  Engineering  Index 
Biological  and  Agricultural  Index 

* * * General  Interest 

* * * Example 

Readers'  Guide  to  Periodical 
Literature 

***  Abstract  Policy 

***  Included 

* * * Examples 

Chemical  Abstracts 

Current  Index  to  Journals 
in  Education 

***  Quitted 

* * * Examples 

General  Science  Index 
Index  to  IEEE  Publications 


* * * 


HXK  TO  DISCIPLINE-SPECIFIC  EXAMPLE 


* * * 


REFTEENCE  TOOLS  (OCOT’D) 

Government  Publications 
***  Government  Documents  Indices 
***  General  Indices 

* * * Examples 

Cumulative  Title  Index  to  U.  S. 
Public  Documents 

Index  to  y.  S.  Government 
Periodicals 

United  States  Government 

Publications  Monthly  Catalogue 

***  Department  Indices 

* * * Examples 

Index  to  GAO  Documents 

American  Statistics  Index 

Scientific  and  Technical  Aerospac 
Reports  ^ 

Indexed  Material 

***  Government  Contracts 

* * * Research  Reports 
***  Government  Depositories 

***  1,355  Sites 

***  Free  ^feterial 

Continual  Updates 


t t * 


HOCK  TO  DISCIPLINE-SPECIFIC  EXAMPLE 


* t * 


REF'EHJiNCE  TOOLS  (CXKT’D) 


Citation  References 

***  A Backward  Search  Tool 

Finds  Sources  Used  by  Researchers 
Indicates  Authorities 
Establishes  Historical  Perspective 
* * * Examples 

Science  Citation  Index 


HOCK  TO  DISCIPLINE- SPECIFIC  EXAMFTJE  * * * 
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THE  CARD  CATALOGUE 


Types  of  Cards 

* * * Author 
***  Title 

* ‘ * Subject 
Data  on  Cards 

* * * Call  Number 

* * * Author 
***  Title 

* * * Publ i sher 

* * * Subjects 
***  Series 

* * * Paging 

Special  Information 

* * * II  lustrations 
***  Tables 

* * * Gazetteer 

* * * HOCK  TO  DISCIPLINE- SPECIFIC  EXAMPLE 


IHE  CARD  CATALOGrUE  (OCNT'D) 


* 


* 


Call  Numbers 

***  Dewey  Decimal  System 
***  Snail  Collections 
***  Limited  Flexibility 
Library  of  Congress  System 
***  Large  Collections 
***  Easily  Extensible 
* * * More  Complex 
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LIBRAKbf  QE^GANIZATICN 


Shelf  Arrangement 

* * * Open  Stacks 

Physically  Grouped 
Encourages  Browsing 

* * * Closed  Stacks 

* * * Limits  Access 
***  Improves  Security 


Floor  Plan 
* * * Example 

Library  of  School 


INPOEMiTICN  RETRIEVAL 
USING  (XMPUTERS 


INFX3EM^Tiasr  RETRIEVAL  USING  CCMPUTEBS 


TABLE  OF  (XNTENTS 


Retrieval  Syst earns 
Online  Searching 
Information  Systems 
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RETRIEVAL  SYSTBVB 


Information  Science 

* * * Manual  Systems 
**•  Library 

* * * Random  Access 

* * * Browsing 
***  Slow 

Available  to  All  Users 
***  Restricted  to  One  User 
Time 

***  Computerized  System 
* * * Data  Base 

* * * Con^jl eteness 

Special  Skills  Required 
***  Simul taneous ly  Avai labl 
Fast 


* * * 


RETRIEVAL  SYSTEMS  (OCNT’D) 

Manual  Search  vs.  Ccnputer ized  Search 

***  Finding  Indices 
*•*  Library 

***  Search  Card  Catalogue 
***  Search  Reference  Books 

***  Online  Systems 

***  Display  Thesaurus 
* * * Search  Index 

***  Coordinating 

* * * Samp  1 i ng 

* * * Output 
Review 


* * t 


ONLINE  SEARCHING 


Advantages  of  Online  Search 

* * * Speed 

* * * Ccnpl eteness 

Accessabi 1 i ty 
***  Cost 
***  Flexibility 

* * * Currency 


CNLINE  SEARCHING  ((XNT’D) 


Disadvantages  of  Online  Search 
***  Cost 

Limited  Historical  Content 

* * * Complex! ty 

* * * Variety 
Range  of  Data  Base 


* * * 


ONLINE  SEARCHING  (OCNT’D) 


Bases 

Centralized  Control  of  Data 
Redundancy  Reduced 
Independence  of  Data 
Integrity  Insured 
Inconsistency  Avoided 
Standards  Enforced 
Data  Shared 
Security  Checked 


CNLINE  SEARCHING  (COSTT’D) 


Data  Bases  (cont’d) 

* * * Producers 

* * * Types 

Professional  Associations 
***  Government  Agencies 
***  For  Profit  Organizations 

* * * Products 

***  Printed  Indices 

***  Machine  Readable  Data  Bases 

* * * Processors 

***  Comnercial  Services 
In  House  Development 
***  Government  Services 


ONLINE  SEAECHING  (CXKT'D) 


t * * 


Data  Bases  (cont'd) 

Mil t idiscipl inary 

Document  Specific 

* * * Journals 
***  Reports 

* * * Proceedings 
***  Unidiscipli nary 

* * * Sciences 
***  Technology 

Social  Sciences 

* * * Humani ties 

* * * Patents 

* * * News 

* * * Law 

* * * Medicine 

* * * Others 
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ONLINE  SEARCHING  (OCNT'D) 


Seme  Data  Bases  and  Producers 
AGRIOOLA 

National  Agricultural  Library  (US  Gov) 
BIOSIS  REVIEV 

BioSciences  Information  Service 

CA  SEARCH 
CA  CONDENSATES 

***  Chemical  Abstract  Source 

INEBGfY  DATABASE 

U.S.  Department  of  Elnergy 

ENEBGfYLINE 

ENVIRDLINE 

ENVIRONVENTAL  IMPACT  STATEMENTS 
**•  Environment  Information  Center 


ONLINE  SEARCHING  ((XNT’D) 


Some  Data  Bases  and  Producers  (cont’d) 
INSPEC 

Institute  of  Electrical  Engineers 
MEDLINE 

***  National  Library  of  Medecine 
METTADEX 

American  Society  for  Metals 

POLLUTION  ABSTRACTS 

Data  Courrier,  Inc 


* « * 


ONLINE  SEARCHING  (OCNT’D) 


Data  Base  Composition 


t * * 
* * * 


Document  File 
Index  Files 
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INPQEMVriCN  SYSTEMS 


***  Information  Systems 

* * * DBVB 

Numeric  Information 
Designed  for  Managers 

* * * IS&R 


* * * 


t * t 


Bibliographic  Data 
Current  Awareness 
Professional  Literature 
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FEATURE  ANALYSIS 
OF 

INITRACriVE  INPQRMATICN 
STCKAGE  AND  RETRIEVAL  SYSTSVB 


USER 


CATBGCRIZATICN 


USER  CATEXKKIZATICN 


TABLE  OF  CCNTEKTS 


Categorization  Rationale 


Category  Definitions 


CATBGCeiZATICN 

RATIONALE 


CATEGORIZATION  RATIONALE 


Categorize? 


Interface/User  A^tching 


Experimental  Groupings 


CATEX5QRIZATICN  RATICMALE  (CX^sTT’D) 


Parameters 


* * * Background 


* 


* « 


* * * 


Job  Functions 
Computer  Expertise 


* * * Experience 


t * t 


t t * 


Generalized  Information  Systems 
Specific  System 
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CATE3GQRIZATICN  RATIONALE  ((XNT'D) 


* * * Categories 


* * * 


* * * 


* * * 


* * * 


* * * 


* * * 


System  Administrators 
Data  Base  Administrators 
AppI  ication  Programners 
Information  Specialists 
End  Users 
Parametric  Users 
Casual  Users 
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CATBGOErf 

rSEFINITICNS 


CATEGORY  DEFINITIONS 


* 


* * 


System  Administrators 
* * Maintain  the  Data  Base  System 
Manage  System  Software 
Supervise  System  Installation 
Provide  Monitoring  Tools 
Enhance  System  Performance 
Provide  Consultation  Services 
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CATEXjQECf  DEFINITICNS  (OCNT'D) 


* 


* 


Data  Base  Administrators 

Maintain  Individual  Data  Base 

Provide  Structure  and  Information 
Content  of  the  Data  Base 

Provide  Security  and  Integrity  Controls 
for  the  Information  in  the  Data  Base 

***  Provide  Liaison  Between  Elnd  Users  and 
Appl  ication  Prograraners 

Monitor  and  Evaluate  Data  Base 
Performance 

* * * Provide  Feedback  to  the  System 
Administrator 
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CATBGCKbf  DEFINITIONS  (CXSvTT  'D) 


* 


* 


Application  Programners 

Provide  EIxtensions  to  the  Data  Base 
System 

***  Develop  New  Appl  i cat  ions 

Modify  Existing  Applications 

Provide  User  Access  Interfaces 
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CATBGCKbf  DEFINITICNS  {(XNI'D) 


Information  Specialists 

***  Act  as  Intermediary  for  Knd  Users 

Familiar  with  a Particular  Set  of 
Information 

Provide  Information  for  Data  Base 
***  Provide  Indexing  for  Information 


CATE]GOK!f  DEFINITICNS  (COSTT'D) 


Users 

Use  Data  Base  Information  in  Job 
Funct ions 

Use  Access  Interfaces  Defined  by 
Appl  ications  Progranmers 

Have  Wide  Variance  in  Expertise 

May  Rely  Totally  of  Information 
Specialist 


CATECOE^  DEFINITICNS  (CXKT’D) 


Parametric  Users 

Invoke  Pre-Defined  Procedures 

System-Ini t iated  Dialogue 

Input  Information  Requested  by 
System 

System  Funct ion  Invoked  by  Input 

***  Interact  with  a Data  Base  in  a Routine 
IV^nner 


CATBGCKbf  DEFINITIONS  (OCNT  D) 


Casual  Users 

***  Infrequent  and  Erratic  System  Use 
Unwilling  to  Learn  Formal  Languages 
Prompting-Oriented  Interface 


* * * 


*********************************** 


• DATA  MDDE3LS 

* * 

* * 

****************tt***t******i^t***** 
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DATA  M3DELS 


TABLE  OF  (XNTENrS 

Basic  Concepts  of  Data  Models 
Flat  File  Data  Model 
Hierarchical  Data  Model 
Network  Data  Model 
Relational  Data  Model 
Cotrparison  of  Data  Models 


BASIC  OO^JCEPTS  OF  DATA  M3DELS 


BASIC  OCNCEPTS  OF  DATA  M3DELS 


Data  Mode  1 s 

Represent  the  Logical  Organization  of 
the  Data  in  the  Data  Base 


* ♦ * 


* * * 


Data  Base 

* * * Co  1 1 e c t i on  of  Entities 
Ent i ty 

Colle.ction  of  Data  Items 
Data  Items 

dual  lest  Logical  Unit  of  the 
Data  Base 
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BASIC  CCNCEPTS  OF  DATA  MDDELS  (OCNT’D) 


* * * 


Data  Models  ( cont'd) 

Represent  Relationships  between  Data 
One,_to_One  Relationships 
One_to_3'Iany  Relationships 
lVfeny_t o_Many  Relationships 
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BASIC  CCNCEPTS  OF  DATA  MDDELS  (OOSTT’D) 


Data  Models  (cont'd) 

* * * Data  Non -Redundancy 
* * * Data  Redundancy 
***  Redundancy  Elimination 

***  Store  Relationships  Rather 
Than  Duplicated  Data  Value 
***  Data  Consistency 
Data  Sharing 


t * * 


BASIC  OCNCEPTS  OF  DATA  IVDDELS  (OCNT’D) 


***  Data  Models  (cont'd) 

* * * Data  Independence 

Logical  Data  Independence 
Physical  Data  Independence 


+ 


+ ---  + 

I I 

I Conceptual  I 

I Level  I < 

! 

+ + 


+ + 

I I 

I Physical  I 

> I Storage  i 

I Level  I 

1 I 

+ + 
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BASIC  CCNCEPTS  OF  DATA  MDDELS  (OCNT'D) 


Four  Primary  Models 
***  Flat  File  Data  M)del 

Hierarchical  Data  Model 
* * * Network  Data  Model 
***  Relational  Data  Model 


FLAT  FILE  DATA  IVDDEL 


FLAT  FILE  DATA  MDDEL 


* * * 


* 


* * 


Simplest  Data  Model 

Pre-Data  Base  Organization 
***  Comnonly  Used  in  File  Processing 
Logical  Units 

* * * Data  Item 

* * * Record  Type 
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HIEHAECHICAL  DATA  MDDEL 


HIEEIARCHICAL  DATA  MODEL 


* * * Tree  structures 
* * * Nodes 

* * * Represent  Records 

* * * Root  Record 

* * * Dependent  Records 

***  Arcs 

Represent  a Link  Between  IWo  Nodes 


* * * 


One_t oJVIany  Relationships 

***  Parents 
***  Children 
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NEJIUaE^  DATA  IVODEL 


NEIWOEaC  DATA  IVDDEL 


*’*  Network  Structures 


* * * 


N : M Relat ionships 

One_To_JV^ny  Relationships 

Many_To_Many  Relationships 

* * * Qvners 

* * * Mesmbers 
***  Sets 


* * * 


Data  Base  Task  Group 
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RELATICmL  DATA  MDDEL 


RELATICNAL  DATA  MDDEL 


* 


* 


Representation  of  Relations 
***  Tables 

* * * Attributes 

* * * Tup 1 e s 

Collection  of  Data  Items 
***  No  Duplicates 
***  Unique  Identifier 
* * * Pr  imary  Key 
•**  Order  of  Data  Items 
Insigni f icant 
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cx^viPARisasr  of 


DATA  MDDELS 


(X2VIPARISCN  OF  DATA  MODELS 


Relational  Model 

***  Supports  Hierarchical  Structures 
* * * Supports  Network  Sturctures 
***  Single 

* * * Ease  of  Understanding 

***  Based  on  Theory  of  Relations 

* * * High  Degree  of  Data  Independence 
***  Supports  High-Level  Query  Language 
***  IWo  Dimensional  Representation 

***  No  Explicit  Qvner  / Member  Links 

Network  Model 

***  Supports  Hierarchical  Structure 
***  Supports  Many_to_Many  Relationships 


CXIVIPimiSCN  OF  DATA  IVDDELS  (CXjNT  D) 


Hierarchical  Model 

***  No  Support  for  Many_to_3^ny 
Re  1 at i onships 

* * * Subset  of  Network  Model 


LOGICAL 

DATA  STECFCTURE 


LOGICAL  DATA  STRUCTURE 


TABLE  OF  COTTENTS 


Data  Types 


Data  Structures 


***********t*****i,t***ttt*****t* 
* * 

* * 

; DATA  TYPES 

* * 

* * 
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DATA  TYPES 


Logical  Representation  of  Data 
Data  Types 

Integer  Alphanumeric 

Character  Real 

Boo  1 ean 

Data  Value  Length 
Data  Value  Range 


* 

* 

DATA  STTOCTURES 

* 
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DATA  STFfUCITOES 


* * * Scalar 

A Single,  Indivisible  Unit  of  Data 


* 


4t 


Array 

***  Homogeneous  Set  of  Data  Values 
Milti-Valued  Data  Items 
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DATA  STRUCTURES  (OOSTT’D) 


Stack 

* • * Input  and  Output  at  One  End 
***  Last - In-Fi rst -Out  Order 


Queue 

Input  and  Output  at  Different  Ends 
•**  First -In-First-Out  Order 

Linked  List 

Link  / Pointer 

***  Relating  TWo  Data  Values 
Nul 1 Link  Field 


t t t 


DATA  STRUCTURES  (CCNT’D) 


* * * Tree  Structure 


* * * Root  Node 

* * * Only  One  Root  Node 
***  No  Entering  Branch 


* 


* * 


Non -Root  Nodes 

Only  One  Entering  Branch  For  Each 
Non -Root  Node 
* * ‘ Paths 
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DATA  STRUCTUIffiS  (CCNT'D) 


Network  Structure 


* 


Each  Element  May  Connect  to  Every  Other 
El  ement 
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FHirSICAL 

STOE?AGE  STRUCTURE 


PH^ICAL  STORAGE  STRUCTURE 


TABLE  OF  OCNTENTS 


Data  Representation 


Device  Characteristics 


Storage  Structuring  Techniques 


Accessing  Techniques 


* 

* 


* 

* 

* 

* 

* 

******** 


DATA 

REFRESENTATICN 

*************************** 
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DATA  REPRESENTATICN 


* * * Ccarputer  W)rd 

Basic  Unit  of  Physical  Data 
***  VJbrd  Size 

* * * Length  of  a W)rd  in  the 
Medium 


* * * 


Physical  Representations  of  Data 
* * * Character  Codes 
***  Numeric  Representations 
***  Null  Value  Representation 
***  Default  Value 

number zero 

character  blank 

pointer nil 


Storage 
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DEVICE 

CHARACTERISTICS 


* ♦ ♦.*  ***^**t*******i^****t*** 


* * * * 


* * * * 


* 

* 

* 

* 

* 

* 

* 

* 

* 
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DEVICE  CHARACTERISTICS 


* 


* * 


* * * 


Access  Modes 

***  Physical  Afepping  of  Data  and  Devices 
***  Sequential  M^de 

* * * Tape 

* * * Di  rect  Mode 

***  Disk 

* * * Drum 
Addressabi 1 i ty 

* * * Addressable  Unit  of  the  Storage  Medium 

Bit  Byte 

W)rd  Block 
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STORAGE  STRUCTURING 
TBCiINIQUES 


STCmGE  STRUCTURING  TECHNIQUES 


♦ * * 


* 


* 


Sequential  Structure 

Records  in  Consecutive  Storage  Locations 

Indexed  Structure 

* * * Keys 

* * * Pr  imary  Key 

* * * Secondary  Key 

* * * Index 

***  Primary  Index 

* * * Secondary  Index 
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STORAGE  STE?UC?rURING  TE3CHNIQUES  ((XNT'D) 


* * * 


* 


* 


Physical  Representation  of  Tree 
***  Sequential  Organization 

Tree  Directory  Organization 
***  Link  Organization 

Physical  Representation  of  Network 
***  Combination  of  Sequential  and 
Organization 

Network  Directory  Organization 


Link 
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* * 

* * 

; ACCESSING  TECHNIQUES 

* ♦ 

* * 


*****************:^i*****:^:^t******tt**t 


ACCESSING  TECHNIQUES 


***  Sequential  Search 

* * * Serial  Search 
***  Block  Search 

* * * Binary  Search 


* * * Indexed  Search 

* * * Linked  List  Search 


* * * 


Direct  Accessing 

***  Sin^Dle  Direct  Accessing 

* * * Hashing  Method 

* * * Advantages 

* * * Fast  Access 

* * * May  Not  Need  Index  Storage 
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♦ * 

; DATA  BASE  DEFINITICN  ' 

♦ * 

**^****t****t*****t^*t^t 
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DATA  BASE  DEFINITION 


TABLE  OF  OCNTENTS 

Model  Definition 
Sulmodel  Definition 

Objectives  of  Model  / Subnodel  Separation 
Data  Base  Elements  Definition 
Data  Base  Definition  Languages 


IVDDEL  DEFINITICN 


* 


* 


Scheana 

***  (XDASYL  Terminology 

Catrplete  Description  of  Information  in 
the  Data  Base 
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SUHV03EL  DEFINITION 


t * * 


Subschema 

***  CX3DASYL  Terminology 

***  Description  of  Subset  of  The  Data  Base 
Accessed  by  Application  Progranmers  or 
Users 
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OBJECTIVES  OF  IVDDEL  / SUBVDDEL  SEPAE^ATIOST 


Elnsure  Data  Base  Privacy 
Ensure  Data  Base  Integrity 
Provide  Specific  User  Views 
Data  Independence 


DATA  BASE  ELEMENTS  DEFINITION 


Data  Item  Names 

Data  Value  Integrity  Constraints 

* * * Data  Types 

* * * Sets  of  Valid  Values 

Ranges  of  Valid  Values 

* * * Data  Values 

***  Unique 
***  Duplicated 

***  User  Supplied  Data  Validation  Procedures 
Data  Grouping  and  Interrelationships 
Data  Ordering  Relationships 
Data  Access  Locks 

* * * Passwords 
***  Access  Control  List 
***  User  Supplied  Access 

Procedures 
Data  Indexing 


Val idat ion 


DATA  BASE  DEFINITICN  LANGfUAGES 


t * * 
* * * 


Define  Data  Base  Elements 

Define  Relations  Between  Occurrences 

Data  Base 


in 


the 
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DATA  BASE 

INTEraJOGATICN  / SEARCHING 


DATA  BASE  INTERBOGATICN  / SEAEOilNG 


TABLE  OF  OCNTENTS 


Searching  Cycle 

Basic  Selection  Constructs 

Index  Searching  And  Free  Text  Searching 

String  Matching  Options 

Existence  Checking 

Logi  cal  Combination 

Data  Base  Searching  Languages 


« 

* 

* 


SEARCHING  CYCLE  * 

* 

***************** 
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SEARCHING  CYCLE 


Logging  In 

^A^ys  to  Access  the  Systems 

* * * Direct  Lines 

* * * Phone  Lines 

* * * Networks 

***  Identify  System  to  be  Used 

* * * Logging  Procedure 

Establish  Conmuni cat  ions 
***  Identification 

* * * User 

* * * Terminal  Type 
***  Security  Check 

***  Accounting  Check 
***  System  Newsletter 


SEARCHING  CYCLE  (CCNT'D) 


Logging  In  (cont’d) 

Considerations 

System  Dependent 
Installation  Dependent 
Type  of  Contract  Dependent 
Other  Factors 

HXK  TO  SYSTEM-SPECIFIC  EXAMPLE 


* « * 


SEARCHING  CYCLE  (COSIT  D) 


Selecting  Files 

Searching  Only  One  Data  Base 
at  a Time 


Merging  Results  If  Possible 


Specifying  a Data  Base 


* * * 


Default  Data  Base 
***  System  Defaul  t 

User  Group  Default 
User  Defaul t 
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SEARCHINGr  CYCLE  (COSTT’D) 


Entering  Ccmnands 
***  Instruction  to  the  System 
Format  of  a Comnand 

{VERB}  (OBJECT) 

OBJECT  = {OPEE^AND}  I (OBJECT  <OPEE^TQR> 
OBJECT} 

Select  Term(s) 

* * * Combine  Sets 


HOCK  TO  SYSTEM-SPECIFIC  EXAMPLE 


* t t 


SEARCHING  CYCLE  (OCNT'D) 


Displaying  Results 

Selecting  a Format 

* * * De  fault 

Complete  Record 
Partial  Output 
Accession  Number 
Abstract 
Author 
Year  . . . 

Any  Combination 

* * * Order 

Chronological 
Alphabetic 
Sort  On  a Key 


SEARCHING  CYCLE  (CCNT’D) 


Online  Output 

***  Faster  but  More  Expensive 

Offline  Output 

Cheaper  but  Slower 
***  Mailed  Printing 
***  Accounting  and  Other  Details 
***  Mai  1 ed  Mat er ial s/ 

Ordering  Documents 

HOCK  TO  SYSTEM- SPECIFIC  EXAMPLE  * * * 


SEARCHINGr  CYCLE  (CCNT'D) 


Logging  Out 

***  Freeing  the  Disks 

***  Temporary  Sets  Are  Lost 

Unsaved  Search  Strategies  Lost 

***  Leaving  the  System 

* * * Reminder  of  Time  Used 

***  Reminder  of  Output  Requested 
Cost  of  Session 

* * * Conments 


BASIC 

SELECriCN  OCMSTRUCTS 


t*t*t*t***t*ttt*ttt*tt 


BASIC  SELECTION  CCMSTRUCTS 


^fetching  Terms 
Relational  Expressions 

<OPERAND>  <Boolean  Operator  > <OPERAND> 

***  Boolean  Operator 

* * * OPERANDS 

Data  Base  Entity  Names 
***  Character  Strings 

<SET1>  AND  < "CHEVUSTRY"  > 


HDCK  TO  SYSTEM-SPECIFIC  EXAMPLE 


* * * 


BASIC  SELECTICN  CC^^STRUC^^S  (CCNT’D) 


Selecting  Terms 

Start  Search  by  Selecting  Term(s) 
***  Locate  Term  in  Dictionary 

EXPAND  <Term> 

Presence  of  Term 
***  Number  of  Hits 
***  Other  Related  Terms 

HOCK  TO  SYSTBVI-SPECIFIC  EXAMPLE  * * * 


BASIC  SELECTICN  COvlSTRUCTS  (CCNT’D) 

Forming  a Set 

SELECT  < Te  rm> 

System  Counts  All  Occurrences  of  <Term> 
* * * Set  is  Formed 

/ 

Number  Assigned  to  the  New  Set 

I 

V 

(System)  : 1 25  <Term> 

I 

V 

Number  of  Hits  (Posting") 

Specialized  Format 

Select  One  Field  Only 

HDCK  TO  SYSTEM-SPECIFIC  EXAMFTE  * * * 
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BASIC  SELEOriCN  CCMSTFaJCTS  (OCNT’D) 


* * * Combining  Terms 

***  Boolean  Logic 

***  Group  Similar  Concepts 
***  Eliminate  Unrelated  Terms 

* * * SELECT  <Terml> 

SELECT  <Term2> 
COVBINE  1 AND  2 

* * * COVBINE  < Te  rml  > 

<Term2> 

***  Combine  Set(s) 

Set ( s ) 

Set(s)  With  Term(s) 
Term(s)  With  Set(s) 
Term(s)  ^Nlth  Term(s) 
HOCK  TO  SYSTEM-SPECIFIC  EXAMPLE  * * * 


AND 

With 
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BASIC  SELECriCN  COMSTEIUCrS  (COSTT'D) 


***  Creating  a Search  Strategy 


* 


Guidelines  for  Effective  Queries 
* * * Build  Queries  Wii  le  Offline 
***  Narrow  Down  Search  Early 
***  Select  Relevant  Concepts 
* * * High  Recal  1 

***  All  Relevant  Ones 
***  High  Precision 

Only  Relevant  Ones 
***  Eliminate  Luplicit 

Quer i es 

HOCK  TO  SYSTEVI- SPECIFIC  EXAMPLE  * * * 
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BASIC  SELECTICN  CCMSTRUCTS  (OCOT’D) 


Polishing  the  Process  Online 
Refine  Strategy 
Modify  Queries 

Getting  Output 

User's  Satisfaction 

Iterative  Process  of  Searching 
Requiring  User/System  Interaction 
Iterative  Sequence 

* * * Browsing 

* * * Selecting 

* * * Retrieving 

HXK  TO  SYSTEM-SPECIFIC  EXAMETE  * * * 
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BASIC  SELBOTICN  CCNSIHUCTS  (OaSTT’D) 


Retrieving  References 
***  Online  Viewing 
***  Offline  Printing 

***  Flexibility  of  Format  vs.  Ease  of  Us 
HOCK  TO  SYSTBVI- SPECIFIC  EXAMETJE  * * * 
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INDEX  SEARCHING 
AND 

FREE  TEXT  SEARCHING 
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INDEX  SE]AEOIING  AND  FREE  TEXT  SEIARCHING 


Index  Searching 

Controlled  Vocabulary 
* * * The  Indexer 

* * * Time  De  1 ay 

* * * Subject i vi ty 

* * * Selection  of 

Dependent 


Terms 


106 


INDEX  SEARCHING  AND  FREE  TEXT  SEARCHING  (CCNT'D) 


Index  Searching  (cont'd) 

* * * Advantages 

***  Speed  of  Search 

Retrieve  Sub jec t -Re  1 at ed  References 
Broad  Concepts  Can  Easily  Be 
Searched 

***  Hierarchical  Concepts 

Concepts  With  Many 
Possible  Names 
***  Ease  of  Use 
***  Printed  Material  Available 
***  EJntry  Vocabulary 

***  Indicates  Postable  Term 
*•*  Automatic  Substitution 

* * * Recognize  Homographs 

* * * Vfeight  Search  Terms 

***  Priority  Based  Search 
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INDEX  SEARCHING  AND  FREE  TEXT  SEARCHING  (COST’D) 


Index  Searching  (cont’d) 

***  Disadvantages 

Limited  to  Pre-Defined  List  of 
Terms 

Difficult  to  Retrieve  Precise  Terms 
If  Not  Indexed 
***  New  Interest  in  a Term 
***  Different  Spelling 
***  Time  Discrepancy 
***  Handling  of  Compound  Terms 

* * * Individual  Terms 

* * * List  of  Terms 

Combination  of  the  IWo 
•**  Time  Inconsistencies  "Within  Many 
Data  Bases 
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INDEX  SEARCHING  AND  FREE  TEXT  SEARCHING  (COsTT’D) 


Index  Searching  (cont'd) 

* * * Constraints  of  Usage 

***  Conplete  Indexing 

Subject  Wfe 11 -Defined 
Controlled  Vocabulary 
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INDEX  SEARCHING  AND  FREE  TEXT  SEARCHING  (CCNT’D) 


Free  Text  Searching 

***  Uncontrolled  Vocabulary 

Necessary  for  Abstract  and  Text 
Search 

* * * Matching 
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INDEX  SEARCHING  AND  FREE  TEXT  SEARCHING  (OCNT’D) 


Fre.e  Text  Searching  (cont’d) 

* * * Advantages 

* * * Ease  of  Use 

* * * Ordinary  W)rds 

* * * No  Need  for  Index  Terms 
***  No  Need  to  Master  Thesauri 

No  Need  to  Master 

Classification  Techniques 
**•  Retrieval  of  Terms  Not  in 
Con  trolled  Language 
***  Retrieval  of  Obscure  Material 
***  Con^leteness , v^en  Term  not  Indexed 
***  Accuracy,  Hit  a Specific  Term 
***  Inmediate  Availability 
**•  Complete  Availability 

Several  Data  Bases  Can  Be  Searched 
"With  Minor  Modifications 
**•  Search  Save  Procedures  Simplified 
***  Allows  Proximity  Search 
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INDEX  SEARCHING  AND  FREE  TEXT  SEARCHING  (CaSTT’D) 


***  Free  Text  Search  (cont'd) 

***  Disadvantages 

***  Slower  and  More  Expensive 
***  No  General  Concepts 

***  Can  Lead  to  Ambiguity 
***  Inconsistency  of  Rules 
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INDEX  SEARCHING  AND  FREE  TEXT  SEARCHING  (COSTT’D) 


Free  Text  Searching  (cont'd) 


* * * Constraints  of  Usage 

No  Precise  Index  Term  Can 
Selected 

***  Uncontrolled  Vocabulary 


Be 
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STRING  MATCHING 
OPTIOSIS 
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STRING  mTCHING  OPTICNS 


Phrase  Searching  in  Dictionary 

Exact  Match 

* * * VJbrd  for  Word 

Substring  Match 

***  Partial  Matching 

Root  Match 

* * * Search  on  a Root 

Pref  ix  Match 

{ DATA 
DAT  ===>  { DATE 

{ DATING 
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STRIM:J  MATCHING  OPTiaSIS  (CaSJT'B) 


Universal  Match  Character 

***  Replacing  a Final  Character 
***  Replacing  One  Enbedded  Character 

{ CCMPETE 
CCMP7TE  ===>  { CCMFUTE 

* * * Replacing  Many  Enbedded  Characters 

CGMP??  ===>  { cavFAcr 

{ CCMFUTER 
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EXISTENCE 

CHECKING 
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EXISTENCE  CHECKING 


Term  Elxistence 

Problem  from  Boolean  Logic 
Negative  Answer  To  a Confusing  Query 

Nu  1 1 Te  rms 

Value  of  a Null  Term 

* * * Search  for  Patents 

* * * Research 

* * * Publ icat ions 

***  Copyright  Issues 
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LOGICAL 

OCMBINATIOSIS 
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LOGICAL  COVBINATICNS 


* 


* 


Boolean  Logic 

Single  Conditions 
***  Union 

* * * Intersection 

* * * Negat  ion 
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LOGICAL  COVBINATICMS  (CCNT  D) 


* 


* * 


Union 


* * * Operators 

* * * CR 

* ‘ * + 

* * * Result 

• • • • Enlarge  Set 

* * * Sum  of  Operands 

* * * Example 

Engineers  OR  Chemists 

Produces  a set  of  people  are  either 

Engineers  or  Chemists. 
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LOGICAL  CaV®INATICNS  (COnTT'D) 


Intersection 
* * * Operators 
* * * AND 


* * * Resul  t 

References  Containing  a Combination 
of  Terms 

Narrow  Set  Definition 

* * * Example 

Engineers  AND  Chemists 

Produces  a set  of  people  ^^o  are  both 
Engineers  and  Chemists. 
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LOGICAL  OOVBINATICNS  (OCMT’D) 


at  ion 

Op  orators 
* * * NOT 


t t t 


Resul t 


* * * Reduce  Set 

***  Set  Difference 

Example 

Engineers  NOT  Chemists 

Produces  a set  of  people  all  of  ar 

Engineers  and  none  of  ^^cm  are  Chemists 
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LOGICAL  COVBINATiaSIS  (OCNT’D) 


* * * Exclusive  OR 


Not  Always  Available 


* * 


Engineers  XDR  Chemists 

Produces  a set  of  people  who  are  either 
engineers  or  chemists  but  not  both. 
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LOGICAL  CCMBINATICNS  (OCNT’D) 
rity 

Order  of  Operations 
Affects  Result 
System  Dependent 
' * * Example 

1 Parentheses 

2 NOT 

3 AND 

4 OR 
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LOGICAL  CaVBINATICNS  (OCNT'D) 


* * * 


Compound  Conditions 

A and  B or  C and  D not  E and  F 
(A  and  B)  or  (C  and  D)  not  (E  and  F) 
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LOGICAL  OaVBINATICNS  (CCNT’D) 


Other  Logi cs 

Weighted  Terms 

***  Assign  Weight  to  Each  Search  Term 
***  Select  a Threshold  Value 
***  Fractional  Search 

***  Enter  a String  of  Terms 

Output  Ranked  According  to  Presence  of 

Terms 

* * * Natural  Search 
***  Examples 

• SVtVRT 

LEADER 

BFOASER 
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DATA  BASE 
SEAE?CHING  LANGUAGE 

*t***tt**$itt****** 
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DATA  BASE  SEARCHING  LANGUAGES 


Historical  Overview 

First  IS&R  Exper iment's 
***  1964:  TIP  (MIT) 

First  Large  Scale  Online  Retrieval 
Systan 

* * * 1965  : NASA/REOCN 

National  Aeronautics  and  Space 
Admini strat ion/REhiote  CCNtrol 
Designed  by  Lockheed  Missiles  and  Space 
Company 

Later  Designers  of  DIALOG 
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DATA  BASE  SEACHING  LANGrUAGES 


Historical  Overview  (cont’d) 

First  Widely  Used  Service 
* * * 1971 : MEDLINE 

MEDLARS  on  LINE 

National  Institute  of  Health 

National  Library  of  Medicine 
Designed  by  System  Development 
Corporation 

Later  Designers  of  CflRBIT 

First  Full  Text  Applications: 

***  1960's:  Data  Central 

Designed  by  Mead 

Legal  Data  Bases  and  Other  Full 
Text  Search 

OBAR,  LEXIS,  NEXIS,  LEXPAT 
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DATA  BASE  SEARCHING  LANGQAGES  ((XNT’D) 


Some  Online  Searching  Software  Systems 

BASIS  (Bat tel  le  Memorial  Institute) 
***  INQUIRE  (Infodata  System  Inc.) 

* • * STAIRS  ( IHVI) 
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DATA  BASE  SEARCHING  LANGUAGES  (CXjOT’D) 


* * 


* 


Some  Comnercial  Processors 

* * * BRS 

(Bibliographic  Retrieval  Services 
Inc . ) 

* * * DIALOG 

(Lockheed  Information  Systems) 

* * * LEXIS 

(Mead  Data  Central  ) 

* * * CEBIT 


(System  Development  Corporation) 
* • * VJESTLm 


(\Afest  Publishing  Company) 
Some  Governmental  Processors 


« « * 


NASA/F 


m; 


sr 


(National  Aeronautics  and 
Administration ) 

* * * MEDLINE 


Space 


(National  Library  of  Medicine) 
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DATA  BASE  SEARCHING  LANGUAGES  (COSTT’D) 


Comparison  of  Systems 

Many  Search  Languages  Available 
Constantly  Changing 

Languages  Per form  Di f ferent  Functions 
Equivalent  Conmands  Are  Not  Identical 
* * * Differences 

Data  Base  Structures 

* * * Sy s tern  Defaults 

* * * User  Needs 
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***********t***^^*ttt****t*t*****t 


DATA  BASE  REPORT  GENEHATICN 

******t*****t***t*t***tttt*ttt*** 
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DATA  BASE  REPORT  GENERATICN 


TABLE  OF  CXaSTTENTS 


System  Defaul t Report  Format 
User-Defined  Report  Formats 


Alternate  Output  Formats 


Report  Generation  Languages 
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SYSTEM  DEFAULT  F 


3T  PC3EMAT 
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SYSTEM  DEFAULT  REFCKT  POEMYT 


Contents 

* * * Chosen  by  System 

***  Dependent  on  Application 
Predetermined 

***  Minimum  Spacing  Factor  between 
***  First  Physical  Print  Position 

* * * Line  Size 

* * * Page  Size 

Column  Width  Equals  Either 

* * * Length  of  Data 

**•  Length  of  Column  Header 
Horizontal  Report  Format 
Headings  Centered 
Underlined  at  Proper  Places 
Sorted  in  First  Column 


Element 
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SYSTEM  DEFAULT  F 


RT  FTQEmT  ((XisTT’D) 


* * * Elxampl  e 1 


Page  1 

STATEMENT  SPOA/ING  EMPLOYEE  STATUS 


Current  Position 

Einployee  Number 

Ehiployee  Name 

Account  Rep 

2345 

Susan  Jones 

Analyst 

4875 

Robert  Norman 

Data-Base  Designer 

1245 

Frank  Snith 

Network  Spec 

2765 

Kirk  "Wi  1 1 iams 

Operator 

3275 

James  Gary 

Security  Ebcpert 

1564 

Phil  Collins 

Software  Spec 

2875 

Anne  Martin 

System  Defaul  t Eleport  Format 
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SYSTEM  DEFAULT  F 


E?T  PCSMVT  (OCNT’D) 


■ ’ ‘ Ebcanpl  e 2 


REFERENCE  CODE:  78 

JOURNAL:  OCMPUTER  DBCISICNS 
VOLUVIE:  8 

ISSUE:  1 

DATE:  JANUARY  1976 
PAGES:  56  - 60 

TITLE:  KEYS  TO  E^B  SECURITY 

AUIHCe(S):  BURNS,  K.  J. 

AEFILIATICN:  CINCCM  SYSTE^B,  INC. 

ABSTRACT:  LEGISLATIVE  AND  SOCIETAL  PRESSURES  ARE 

piCKCING  DP  MANAGERS  TO  RESTRUCTURE  IHE  SECURITY  OF 
THEIR  DATA  BASES . THE  BIG  QUESTICN  EACH  IWLIST  ASK 
IS,  W©  IS  SITTING  AT  THE  TEFMINAL?  ' 

KEYWCEDS:  DATA  BASE  ARCHITECTURE, 

SECURITY-ENHANCING  FEATURE 
CATEGCRIEB:  4.22  * 4.33 
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USER-DOEFINED  REPCKT  FQEmTS 
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USER-DEFINED  F 


RT  PQEMVrS 


Report  Content 

Select  Data  Elements 
***  Choose  Strings 

* * * Ccarpute  Values 

* * * Counts 

•**  Sub  Totals 
***  Totals 

Title  and  Header  Suppressed  on  New  Page 

* * * Choice  of 

* * * Def aul t Ti 1 1 e 

***  User  Chosen  Title 
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USER-DEFINED  REPORT  FX3EMVTS  (CCNT’D) 


* 


* * 


Data  Elditing  Formats 
***  Specifications 
***  Line  Size 

* * * Page  Size 

*•*  Spacing  Factor 

* * * Under  1 ining 
***  Header  Width 

***  Header  Centering 

* * * Maximum  Pages 

***  Left  / Right  Justification 
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USER-DEFINED  F 


E7T  PCe^TS  (CXaSTT’D) 


User  Created  Formats  Library 

* * * Da  t a Ed  i t i ng  Fo  rma  t s 

* * * Stored  in  Library 

Called  by  Simple  Comnands 
***  Macros  Defined 

* * * Library  Comnands 

***  Invoked  for  Desired  Display 
Report 

***  MDdified  for  Changing  Demands 
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* * ♦ 


USER-DEFINED  REPORT  PaTO^TS  ((XNT'D) 
Exanpl  e 1 


Page  1 


Depar  tment 


^un  t s 


Data 

i^rocess  ing 


Ei?>loyee  Status  Statonent 

E 

F 


Eipl  oyee 
Number 

Eiployee 

Name 

Salary 

K 

Status 

0115 

0124 

0678 

Gary,  Sobers 
Lloyd,  Clive 
Robert,  Andy 

30.000 

22.000 
20,000 

Sr . Manager 
Accountant 
Acct  Clerk 

1345 

1567 

1875 

Kanhai , Rohan 
Landry,  Steve 
Peter,  Joe 

31,255 
27 , 755 
25 , 550 

Network  Sp 
Sr.  Analyst 
Progranmer 

User -Defined  Output 


Format 
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ALTEE^NATE  OUTPUT  PCOVIATS 
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ALTEE5SIATE  OUTPUT  PQEMVTS 


Printed  as  Binary  Output  Files 
Ccarputer  Output  to  Microfilm 
Graphical  Displays: 

* * * Histograms 
***  Plots 

* * * Bar  charts 

* * * Pie  charts 

***  Frequency  Charts 
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RT  GENEBATICN  LANGfUAGES 


***t**tt***tt************** 
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F 


RT  GENEBATIOSr  LANGUAGES 


***  Language  Coranands  Facilitate 

* * * Formatting 

* * * Report  Headers 

* * * Footnotes 
***  Titles 

* * * Rearranging  Records 

* * * Erasing 

* * * One  or  More  Rows 
***  One  or  More  Columns 

* * * Setting 

***  Line  Spacing 
•**  Line  Size 

* * * Page  Size 

Setting  Output  Destination 
***  High  Speed  Printer 

* * * Disk 

* * * Terminal 


HOCK  TO  SYSTEM- SPECIFIC  EXAMPLE  * * * 
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DATA  BASE  UPDATE 
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DATA  BASE  UPDATE 


TABLE  OF  OaSTTENTS 

Update  Operations 
Update  Data  Formats 
Update  Modes 
Update  History  Files 
Update  Conflict  Control 
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UPDATE  OPEE^ATICNS 


Recognize  Changes  to  Be  Made 

* * * Add 
***  Delete 

* * * Change 
Check  All  Factors 

***  Update  All  Stored  Copies 

***  Update  All  Stations  in  Network 

Perform  Update 
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UPDATE  OPEE?ATICNS  ((XNT’D) 


Adding  New  Values: 

* * * Example 

INSECT  BOCK  TITLE  IS  (XMFXJIER  DATA  BASE 
CeGANIZATICN"  AUTHOR  IS  "IVtffiTIN,  JAIVB’’ 
PUBLISHER  IS  "PRENTICE-HALL,  INC"  PRICE  IS 
$38.50  SUBJECT  IS  "DATA  BASE  LOGICAL  AND 
IHYSICAL  DESIGN"  . 


Deleting  Elxi sting  Values: 

* * * Eixample 

DELETE  BOCK  TITLE  IS  "SPACE"  AUTHOR  IS 
"MICHENER,  JAMES"  . 


Changing  Existing  Values: 

* * * Eixample 

CHANGE  AUTHOR  TO  MVCTIN,  JAMES"  FCe  BOCK 
TITLE  "CCIVIPUTEIl  DATA  BASE  ORGANIZATICN"  . 
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UPDATE  DATA  PCfEMVTS 


Predef ined 
* * * Exanpl  e 
CE^ANGE  price  to  33.00 


Ccirputed 
* * * Exairpl  e 

CHANGrE  price  to  price  * 1.1 
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UPDATE  MODES 


Unconditional  Update: 

* * * Exanpl e 

GET  record  number  1 CHANGE  book  price. 

Conditional  Update: 

* * * Eixample 

IF  BOCK  TITLE  = "OCIVIFUTER  DATA  BASE 
CRGANIZATICN"  AND  AUTHOR  = ]\^VRriN,  JAMES" 
THEN  CHANGE  BOCK  PRICE. 
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UPDATE  HISTOKir  FILES 


Transaction  Log 

Record  of  Transaction 
Before  Image 
* * * Roll  Back 
* * * After  Image 

***  Roll  Forward 
Audit  Trail 

Record  of  Accesses 
Record  of  Activities 
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UPDATE  OCKFLICr  OOSTTROL 


Miltiple  User  Update  Problem 


* * Exairpl e 


cashier  1 get  customer  A subtract  update 

record  $100  from  file 

balance 


tl  t2  t3  t4 

cashier  2 get  customer  A subtract 

record  $50  from 

balance 

New  balance  = old  balance  - $50. 


\ 


t5 

updat 

ile 
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UPDATE  CONFLICT  (XNTE«DL  (CONT'D) 


Solut ions 

Lockout  Mechanisms 

Restrict  Access 
Avoid  Simultaneous  Update 
* * * Timestamping 

Record  Transaction  Request  Times 
* * * Ordered  Updates 

Prevent  Information  Loss 
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DATA  BASE  REDEFINITIOST 

***t***t**t***1^t*tt*t* 
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DATA  BASE  REDEFINITICN 


TABLE  OF  OaSTTENTS 

Need  for  Data  Base  Redefinition 
Logical  Data  Structure  Redefinition 
Physical  Storage  Structure  Redefinition 
Language  Facilities  for  Data  Base  Redefinition 
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NEED  FOR  DATA  BASE  REDEFINITIOST 


System  Redefinition 
***  Add  New  Function 
***  Delete  Old  Function 
Performance  Improvement 

* * * Save  Time 

* * * Increase  Size 
Changes  in  Data  Semantics 

Add  New  Relation  Between  Data  Items 
Delete  Old  Relation  Between  Data 
I terns 
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LOGICAL  DATA  STEBJCTURE  REDEFINITICN 


Regrouping  of  Data  Items 
Redefining  Data  Ordering  Relationships 
Changing  Data  Validation  Criteria 
Adding  New  Relations 
Redefining  Existing  Relations 
Deleting  Existing  Relations 
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IMfSICAL  STCeAGE  STE?UCTURE  REDEFINITION 


Redefining  Indexing  Policies 
Adding  New  Indices 
Deleting  Existing  Indices 
Adding  New  Data  Items 
Deleting  Existing  Data  Items 
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LAI^CrUAGE  FACILITIES  PCR  DATA  BASE  REDEFINITION 


Need  for  Data  Base  Redefinition  Languages 
* Extensions  to  Data  Base  Definition  Languages 
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AIMINISTE^ATIVE  FUNCTICNS 


166 


ATMINISTE^ATIVE  FUNCTICgSiS 


TABLE  OF  CXInTTENTS 


System  Administrator  Functions 


Data  Base  Administrator  Functions 
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SYSTEM  AIMENISTERATCe  FUNCTICNS 


Originating  the  System 

Establishing  Initial  System  Objectives 
and  Requirements 

***  Planning  and  Scheduling  Phased  System 
Develoiment 

***  Gross  System  Design 

Detailed  System  Design 

***  Selection  and  Acquisition  of  Computer 
Equipment  and  System  Support  Software 
Coding  and  Implementing  the  Information 
System 
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SYSTEM  ACMENISTE^ATCe  FUNCTIOSIS  ((XNT’D) 


Operating  the  System 
***  Generating  Files  and  Data  Bases 
System  Qual i ty  Assurance  Testing 

* * * Obtaining  Acceptance  of  System 

Training  of  System  Operations  Personnel 
***  Education  of  System  Users 
***  Completing  Transition  from  Old  System  to 
New  System 

***  System  Maintenance 

* * * Future  Enhancement 

***  Periodic  System  Evaluation 
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DATA  BASE  ADVENISTE^ATQR  FUNCTIONS 


Detailed  Data  Base  Design 

Coding  and  Implementing  the  Data  Base 

Generating  Files  for  Data  Base 

Data  Base  Quality  Assurance  Testing 

Obtaining  Acceptance  of  Data  Base 

Completing  Transition  from  Old  Data  Bas 

to  New  Data  Base 

Data  Base  Maintenance 

Future  Data  Base  EInhancement 

Periodic  Data  Base  Evaluation 
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DATA  BASE  SECURITY 
OCNSIDERATIOB 
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DATA  BASE  SECURIIY 
CX3VJSIDEBATICNS 


TABLE  OF  (XNTENrS 

Data  Base  Security  Threats 
Physical  Protection 
Authent i cat  ion 
Authorization 

V 

Security  Logging 
Security/Privacy  Transformations 
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DATA  BASE  SECURITY  THREATS 


Unauthorized  Alteration 
Improper  Disclosure 
Destruction 

Examples 

“Wiretapping 

Hacking 

Sabotaging 

Trespassing 
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PHYSICAL  PROTEOTICN 


Miniimim  Protection 
***  Fire  and  Burglar  Alarms 
* * * Locks 

Tighter  Protection 

***  Preventing  Eavesdropping 

***  Background  Noise 


174 


AUIHENTICATiasr 


Verification  of  Identity 

Software  Authentication  Technologies 

* * * Password 

Questions  and  Answers 

* * * Lock  and  Key 

Generated  by  Complex  Algorithms 
or  Chosen  by  User 

***  Restricts  Incorrect  Login  Attempt 
***  Notify  User 
***  Notify  Administrator 

* * * Safeguarding  Password 

***  Reauthenticate  User’s 
Ident i f i cation 
***  Scheduled  Activity 
**•  Extraordinary  Occasion 

* * * Cryptography 

* * * Dial  Back  Technique 
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AUIHENTICATiasr  (OOSTT’D) 


Physical  Authentication  Techno log 

* * * Signature 

***  Machine  Readable  I.D.  Cards 

* * * Fingerprints 

* * * Voicepr ints 
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AUIH3RIZATICN 


/ 

Verification  of  Access  Rights 


* * * 


Methods  For  Authorization 
* * * Password 
***  Cryptography 
***  Access  Control  List 
***  Procedure-Based  Access  Control 
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AUIHCeiZATIOSr  (OOSTT’D) 


Access  Control 

***  User  Identification  and  Activ 
Controlled  by  Data  Base  Administrator 

•**  Requires  an  Arbiter  Program 

***  Access  Problems 

***  Impediment  to  Legitimate  Users 

* * * Increased  Overhead 

* * * Increased  Response  Time 
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SECURITY  LOGGING 


Security  Logging  Process 
***  Collect  Information 
***  Maintain  History 
***  Support  Analysis 
Threat  Monitoring 

***  Detected  Data  Security  Threats 
***  Reaction  to  Threats 
***  Real-time  Threat  Monitoring 
**•  Non-real  - 1 ime  Threat  Monitoring 
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SECURIIY  / PRIVACY  TRANSPCfEmTICNS 


Data  Encoding 
***  Conceals  Information 
***  Encryption/Decryption  Key 
Methods  of  Security  Transformations 
***  Substitution  Ciphers 
***  Transposition  Ciphers 
* * * Product  Ciphers 
***  Exponentiation  Ciphers 
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SECURITY  / PRIVACY  TRANSPCSMVTICNS  (CCNT'D) 


Exanples  of  Substitution  Cipher 


C ->  R,  O ->  E,  M->D,P->V,U- 
T ->  I,  E - > B,  R - > X,  ... 

• • ■ COMPUTER  - - - > REDVCIEC 

S ->  M,  E - > A,  C ->  T,  U ->  R,  R - > 
I ->  C,  T ->  E,  Y ->  S,  ... 

• • • - - - > MATRICES 
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SECURITY  / PRIVACY  TRANSPOEM^TICMS  (OOSTT’D) 


Example  of  Transposition  Cipher 
* * * A:  00,  B:  01,  . . 


* * * Key:  RCA 

* * * SCIENCE  - - - > 

* * * RCAECAR  ---> 

* * * Add  above  > 

* * * Ciphertext  > 

* * * Note  that  the  add 


, Z:  25 

18  02  08  04  14  02  04 
17  02  00  17  02  00  17 
09  04  08  21  16  02  21 
J E I V Q C V 

operation  was  mod  26 
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PEEIFIQEM^CE  MEASUREMENT 
AND 

EVALUATIOST 


*t***t*ttt******t**:^tt* 
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PEFttUtM^CE  MEASUREVIENT  AND  EVALUATICN 
TABLE  OF  (XNTENTS 

User  Interface/Interaction  Orientations 
System  Execution  Efficiency  Orientations 
Tools  and  Techniques 
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USER  INTERFACE/ INTERACTICK 
CRIENTATIOSB 
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PEE^PQEM^NCE  MEASURBVIENr  AND  EVALUATION 


TABLE  OF  OCNTENTS 

User  Interface/Interaction  Orientations 
System  Execution  Efficiency  Orientations 
Tools  and  Techniques 
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XJSER  INTERFACE/ INTERACriCN 
aRIENTATICNS 
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USER  INTEE^FACE  / INTEElACriCN  CRIHSITATIC8SIS 


Support  for  User-Oriented  Analysis 

***  Costs 

* * * Performance 

* * * Benef its 

* * * Measurement  Parameters 

* * * Response  Time 

* * * Convenience  of  Access 

* * * Conmand  Language 

* * * Format  of  Output 
***  Volume  of  Output 

User  Effort 
***  User  Expectations 
***  Overall  Satisfaction 
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SYSTEM  EXEXXrriCN  EET’ICIENCY 
CeiENTATICN 
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SYSTEM  EXEXOTICN  EFFICIENCY  CeiENTATION 


+ 

I 

+ 


User  Level 


+ 

I 

+ 


V 


Level 


+ 


V 

H 

I Logical  Data  Base 
I Organization 


+ 


+ 


+ 


+ 


+ 


+ 


+ 

I 

+ 


V 

Phys  ical  Storage 
Organization 


V 

Underlying  Machine 


+ 


+ 


+ 

I 

+ 


Hierarchical  IS&K  Elvaluation  Model 
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SYSTEM  EXE3COTICN  EFFICIENCY  aRIENTATICN 


Sample  Measurement  Parameters 


* * * User  Level 

***  Maximum  Number  of  Retrievals 

Desired 

***  Number  of  Searches  Conducted  per 
Session 

Logical  Data  Base  Design  Level 
***  Number  of  Relations 

* * * Number  of  Record  Types 

Logical  Data  Base  Organization  Level 

Record  Counts  for  Data  and  Index 

Files 

***  Logical  I/O  Cost  for  Each  Access 
Path 

***  Physical  Storage  Organization  Level 
***  Total  Storage  Requirements 
**•  Physical  I/O  Costs 

•**  Underlying  Machine  Level 
***  CPU  Instruction  Rate 

* * * Main  Memory  Size 
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TOOLS  AND  TECHNIGJUES 
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TOOLS  AND  TECHNIQUES 


Moni tors 

***  Software  Moni  tors 
***  Hardware  Moni  tors 

Models 

***  Analytical  Model 
***  SiMilation  Model 
***  Queueing  Model 

Benchmarks  and  Synthetic  Programs 

Subjective  Measures 
***  User  Questionnaires 
***  Evaluation  Forms 
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TOOLS  AND  TECHNIQUES  (COSTT’D) 


tors 


Data  Collection  Method 


Software  Monitors 

Computer  Programs 
***  Inserted  in  System 

Record  Events  of  Interest 

* * * Exan^l  es 

Duration  of  Search 
Number  of  Queries 
Number  of  Errors 

Hardware  Monitors 
***  Electronic  Devices 
Ehibedded  in  Computer 
Extract  Performance  Data 

* * * Examples 

Number  of  Page  Faults 
Number  of  Files  Accessed 
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TOOLS  AND  TECHNIQUES  (CXaSTT’D) 


Is 


Analytic  Models 

Mathematical  Representation 
Various  Levels  of  Complexity 
Used  for  Specific  System  Components 
Good  for  Supplementing  Major 
Evaluat ions 


Queueing  Models 

Subset  of  Subset  Analytic  Models 
Examines  Resource  Contention 

* * * System  Loads 

* * * System  Resources 

Gauges  Effects  of  Changes 


Simulation  Models 
***  Imitation  of  System 
***  Most  Powerful  Technique 
***  Most  Flexible  Technique 
***  High  Development  Cost 
Difficult  to  Validate 
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TOOLS  AND  TECHNIQUES  ((XOT’D) 


Benchmarks 

Mix  of  Existing  Programs 
* * * Actual  Running  Jobs 

Measure  Different  Aspects 
Performance 
* * * Portable 
***  Tightly  Controlled 
***  Provide  Standard  of  Comparison 
***  Different  Systems 
***  Different  States  of  One  System 


Synthetic  Programs 

* * * Structured  Sequence  of  Comnands 

Measure  Specific  System  Act ivi t ies 
Coded  Like  a Program 

* * * Not  an  Actual  Job 

Bnulate  Pro jected  W)rkload 
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TOOLS  AND  TECHNIQUES  (OCNT’D) 


Subjective  Measures 
***  User  Questionnaires 
Evaluation  Forms 
Sample  Parameters 
* * * User  Classes 

* * • Frequency  of  Use 

Mode  of  Operation 
***  Systems  Experience 
***  System  Characteristics 

* * * Onl ine  Help 

* * * User  Control 

* * * Ease  of  Learning 

***  Flexibility  in  Task  Handl 
***  Fault  Tolerance 

Correspondence  with 
Expectations 
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BIBLIOGRAPHIC 
DATA  BASE  DESIGN 
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BIBLIOGKAfflIC 


DATA  BASE  DESIGN 


TABLE  OF  CXKTENTS 


Bibliographic  Data  Base  Organization 


Document  File  Design  Considerations 


Types  of  Files 
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BIBLIOGa^AHlIC 
DATA  BASE  ORGANIZATIGN 
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BIBLIOGRAPHIC  DATA  BASE  CeCANIZATICN 


Item  or  Field 

* * * Smallest  Unit 

* * * Specific  Data 

* * * Examples 

Title 
Abstract 
Journal  Name 
Volume  Number 

Group 

***  Collection  of  Items 

Structured  by  Relationship 

* * * EIxample 

Publisher  Address 
Consists  of 

Post  Office  Box  Number 

City 

State 

Zip  Code 
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BIBLIOGaE?AHnC  DATA  BASE  CeGANIZATICN  (OCNT’D) 


* * * Record 

***  Collection  of  Items 
***  Represents  One  Document 
* * * Examples 

Book  Record 
Article  Record 


* * t 


* * t 


File 

Collection  of  Record  Occurrences 
Usually  Related  Documents 
***  Examples 

Research  Project  File 
Book  File 

Foreign  Language  Book  File 
Data  Base 

***  Collection  of  Files 
Relationship  Optional 
* * * Examples 

Chemical  Data  Base 
Educational  Data  Base 
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BIBLIOGRAPHIC  DATA  BASE  CRCxANIZATICN  (CCNT'D) 


DATA  BASE 

Engineering  Data  Base 


FILE 

Research  Project  File 


REOCRD 

Article  Record 


GROUP 

Publisher's  Address 


ITEM 

Author's  Last  Name 


i 
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DOCUMENT  FILE 
DESIGN  OCNSIEEE?ATia« 
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DOCUMENT  FILE  DESIGN  OCNS I DERATIONS 


Bibliographic  Data  Types 

*-*  Alphabetic 

Example:  Author  Name 


* * * 


* * * 


* t * 


A1 phanume  r i c 

* * * Example : Title 

Integer 

***  Example:  Volume  Number 

Real 

Example:  Index  Number 

Character 

***  Example:  Abstract  of  Document 

Boo 1 ean 

***  Exan^jle:  True  or  False 
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IXKXlVENr  FILE  DESIGN  OOSISIDEE^TICNS  (OCNT'D) 


Record  Design 

***  Define  Index  or  Key  Items 

***  Relationships  Between  Data  Items 

Length  of  record 

* * * Fixed 

* * * Variable 

Choose  Record  Format 
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IX)ClIV1ENr  FILE  DESIGN  (XNSIDEE^ATICMS  (OCKT'D) 


Data  Usage  and  Updating 

User  Query  Requirements 
* * * Frequency  of  Data  Usage 

***  Frequency  of  Data  Updating 

* * * Change 

* * * Insert 
***  Delete 

File  Structure 

Types  and  .Amount  of  Data  Stored 
Types  and  Amount  of  Data  Retrieved 
Available  Physical  File  Organizations 
***  Performance  Estimate 
***  Cost  / Benefit  Evaluation 
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TYPES 


OF  FILES 


*tt******t********* 
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TYPES  OF  FILES 


Document  Files 

***  Contain  the  Physical  Document  Information 

***  Very  Large  Files 

***  Primarily  Textual  Data 

* * * Stored  by  Character  Code 
* * * Exanpl es 
ASCII 
EBEDIC 

***  Fixed  or  Variable  Length  Fields 

Index  Files 

***  Contain  Indices 
***  Support  Data  Access 

***  Examples  of  Indices 

Title 

Subject  Term 

Library  of  Congress  Number 
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TYPES  OF  FILES  (OCNT'D) 


Thesaurus  Files 


* * * 
* * * 


* * * 


* * * 


Collection  of  Thesaurus  Terms 
Narrower  Term 
* ‘ * Example 


OCMPUTER > MICF 


irtt 


MPUTER 


Broader  Term 
* * * Example 

MI(3CKXIV1HJTER > CCMFXJTER 


Related  Term 
* * * Example 

(XMFTJrER > MICBOCHIP 


Synonymous  Term 
* * * Example 

ROBOT > W3RKING  M^INE 
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TYPES  OF  FILES  ((XNT’D) 


Sairple  Search  File 

Collection  of  Typical  Searches 

Introduction  for  New  Users 

Guidance  for  Improvement  of  Search  Skill 

HOCK  UP  TO  SYSTEM  EXAMPLE  * * * 
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TYPES  OF  FILES  ((XOT’D) 


* * * User  Profile  File 

User  Interests  Description 
***  User  Specified  Terms 
***  Logical  Combinations 
Used  for  Selective  Dissemination  of 
Information  (SDI) 

***  Periodically  Performed 
***  Extracts  New  Material 


* * * 


HOCK  TO  SYSTEM-SPECIFIC  EX/SVIPLE 


* * t 
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BIBLIOGE^AmiC 
FILE  STRUCTURE 
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BIBLIOGRAPHIC  FILE  SIEUCKJRE 


TABLE  OF  OaSTTENTS 


Linear  File  Organization 
Indexed  File  Organization 
List  Structured  File  Organization 
Tree  and  Network  File  Organization 
Clustered  File  Organization 
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LINEAR  FILE 
CHGANIZATICN 
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LINEAR  FILE  QRGANIZATIOSr 


Unordered  Sequential  File 

Unordered  Collection  of  Records 
Sinplest  File  Structure 
Serial  Search  Required 
Easy  Data  Insertion 
Good  for  a Snail  Data  File 
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LINEAR  FILE  CeGANIZATIOST  (OCNT’D) 


Ordered  Sequential  File 

***  Sequentially  Sorted 

By  Key  Field  of  Each  Record 

•**  Binary  or  Block  Search  Possible 

File  Rearrangement  Required  for 
Insertion 
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LINEAR  FILE  ORGANIZATICN  ((XNT’D) 

Tradeoffs 
* * * Advantage 

***  Minimum  File  Maintenance  Process 
Required 

***  Easy  Data  Insertion 
Easy  Data  Deletion 
***  Disadvantage 

Inefficient  Information  Retrieval 
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INDEXED  FILE 
C0E«iANIZATICN 
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INDEXED  FILE  CeGANIZATIOST 


Indexed  Sequential  File 

***  One  or  More  Indices 

***  Provide  File  Access 

***  Degree  of  Indexing 

***  Full  Indexing 

***  All  Key  Values  in  Index 
***  Partial  Indexing 

* * * Subset  of  Key  Values  in  Index 
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INDEXED  FILE  QE^ANIZATiaST 


Indexed  Non- sequent ial  File 

***  One  or  M>re  Indices 

***  Provide  File  Access 

Requires  Full  Indexing 

Also  Called  Random 
Organization 


Accessi 
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INDEXED  FILE  CeGANIZATICN  ((XNT'D) 


Tradeoffs 

* * * Advantages 

***  Ensures  Quick  Access 

***  Efficient  Storage 

***  Disadvantage 

***  Indices  Must  Be  Stored  and 
Wien  Change  Occurs 


Updated 
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LIST  STEIUCrURED 
FILE  ORGANIZATICK 
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LIST  STE^UCKIRED  FILE  CeGANIZATIOST 


Singly  Linked  List 

***  One  Link  Per  List  Entry 
***  Uni -direct ional 
***  Physically  Separate  Entries 


222 


LIST  STRUCTURED  FILE  GFOANIZATICN  (OCKT’D) 


Doubly  Linked  List 

TWo  Links  Per  List  Entry 

* * * Forward  and 

* * * Backward 
Circularly  Linked  List 

***  Singly  Linked  List  or 
* * * Doubly  Linked  List 

***  Last  Element  Linked  to  First  Element 
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LIST  STE?UCTURED  FILE  CfE»ANIZATICN  (0(3<rr'D) 


Inverted  File 

***  Lists  of  Pointers 
***  Used  for  Indices 

* * * Phys  cal ly  Separate  from  Data 
***  Most  Comnon  Implementation 

* * * Fast  Access 

***  Efficient  Storage 
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TE?EE  AND  NEnW3RK 
FILE  CeGANIZATICN 
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TREE  AND  NEIVIDRK  FILE  CBGrANIZATICN 


Tree  Structured  File  Organization 

* * * Basic  Terms 

* * * Parent  / Child 

***  Directed  Link 

* * * FRCM  Parent 

* * * TO  Child 


* * * Root  Node 

• * * No  Parent 

***  Leaf  Node 

No  Child 

•**  Level  Number 

Number  of  Steps  from  Hoot  to 

Node 


t t t 


Degree 

**•  Number  of  Children  of  a Node 
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TE?EE  AND  NEJIW3FK  FILE  QFIGANIZATICN  (OCNT’D) 


* * * Binary  Tree 

* * * Node  Degree 
***  IWo  (2) 
***  One  (1) 
***  Zero  (0) 
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TE^  AND  NEEAOFK  FILE  (JBGANIZATICN  ((XOT’D) 


* * * Balanced  Tree 

***  All  Leaves  on  Last  2 Levels 
***  Higher  Levels 

* * * Equal  Node  Degree 
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TREE  AND  NEIVU3RK  FILE  CeGANIZATICN  (OCNT’D) 


Simple  Network  and  Complex  Network 
***  Simple  Network 

* * * Mappings 

* * * One-  to-One 

* * * One  -to  -Many 

* * * Many- to-One 


***  Complex  Network 

* • * Mappings 

*•*  Include  Many- to -Many 


229 


(XUSTEHED  FILE 
CKGANIZATICN 
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CLUSTERED  FII^  QE^GANIZATICN 


ter 

Collection  of  Records 

* * * Cornnon  Concept 

Logically  Partitioned 
May  Be  Physically  Adjacent 

* * * Faci 1 i tates 

***  Faster  Searching 
***  Faster  Retrieval 
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CLUSTERED  FILE  Cat^IANIZATIONr  (OCNT'D) 


Cluster  Generation 

***  Classi f icat ion  Methods 

* * * Comnon  Term  Classes 
***  Similarity  of  Keywords 
***  Statistically  Related  Document 
* * * Cluster  Membership 

***  Not  Limited  to  One  Cluster 
***  Overlap  Possible 
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CLUSTEEMD  FILE  CeOANIZATIOsT  (OCNT  D) 


Cluster  Search 

***  Inverted  File  Search 

Match  Search  Request  Against  All 
Clusters 

* * * Retrieve  Proper  Cluster 

Match  Request  Against  Individual 
Documents 

Retrieve  Specific  Document 
***  Automatic  Retrieval  of  Related 
Documents 
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CLUSTEEIED  FILE  QRGANIZATICN  (CCNT’D) 


Cluster  Search  (cont'd) 

***  Cluster  Hierarchy 

***  Groups  of  Clusters 
* * * Broader  Coverage 
***  Many  Possible  Levels 


I Cl  I Highest  Level 


/ 

/ 

/ 


I C2  I 


/ I 

/ I 

/ I / 

I C4  I I C5  I I C6  I 


I C3  I--  Mid  Level 


/ I I 
/ I I 

I I 

I C7  I I C8  I Lowest 
Level 
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CLUSTEKED  FILE  COGANIZATICN  (OOSTT’D) 


Cluster  Search  (cont'd) 

* * * Top-Down  Strategy 

Highest  Level 
to 

Lower  Levels 


***  Bottom-Up  Strategy 


Lowest  Level 
to 

Higher  Level 
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CLUSTERED  FILE  CeGANIZATIOST  (OCNT’D) 

Tradeoffs 
* * * Advantages 

Easy  Basic  Concept 

Efficient  Information  Retrieval 

***  Disadvantages 

Complexity  of  Cluster  Generation 

***  Excessive  Storage 

Continuous  Restructuring  As  Updat 
Occur 
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f 


VOCABULARY 

OCNIROL 
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VOCABULARY  OCNIRDL 


TABLE  OF  (XNTENTS 

Controlled  Vocabularies 
Free  Text  Approaches 
Thesaurus  Support 
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*********************************** 


OasraOLLED 

* 

VOCABULARIES 

* 

***************t**********i^t*^^****i^}|^ 
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(XNIRDLLED  VOCABULARIES 


List  of  Index-Search  Terms 
***  Consistent  Indexing 

Search-Index  Cor respondenc 
Compound  Concepts 
***  Pre-Coordination 
***  Post -Coordinat ion 
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(X^^roOLLED  VOCABULARIES 


List  of  Index-Search  Terms 
***  Predefined  List 
Post able  Terms 

Document  Class  for  Each  Term 
Related  Documents 
Snail  Vocabulary 

* * * Advantage 

***  Recall 

Easier  to  Find  Documents 
***  Disadvantage 

Retrieves  Irrelevant 
Documents 

Large  Vocabulary 

* * * Advantage 

Few  Irrelevant  Documents 
Good  Precision 
***  Disadvantage 

Fails  to  Find  Some 
Documents 
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(XXSrroOLLED  VCXIABULARIES  (COSTT’D) 


Exan^l  e 


Find  BROU\N  BEIEAD 

Language  A Language  B Language  C 


Food  Food  Food 

Grain  Products  Grain  Products 
Bread  Bread 

Form 
Loaves 
Rolls 
Ingredient 
Brown  Bread 
Wiite  Bread 


hi 


Aitchison 
Uonst ruction, 
1972.] 


1 Gi  lehr  ist Thesaurus 
Practical  Manual,  As  lib,  London, 


* * * HOCK  TO  DISCIPLINE-SPECIFIC  EXAMET^  * * * 
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CXKrFaOLIiED  VOCABULARIES  (OCNT'D) 


Controlled  Vocabulary  Provides 
***  Consistent  Indexing 

Indexers  Limited  to  Listed  Terms 
More  Likely  to  Choose  Same  Terms 


Indexer:  "It's  about  the  Civil  V^r , the  thesaurus 
says  to  use  VMl  BEJIVEEN  IHE  STATES.  " 


* * * *** * Indexing  Steps 

Analyze  Concept  of  Document 

***  Assign  Index  Terms 


I 
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OOSTTROLLED  VOCABULARIES  (CCNT’D) 


Search-Index  Correspondence 

Searchers  Limited  to  Listed  Terms 
More  Likely  to  Choose  Correct  Terms 


Customer:  "I  need  a book  about  the  Civil  V^r . 
Librarian:  "Look  under  VMl  BETVEEN  THE  STATES 

Customer:  "I  found  it,  thanks." 


* * * *** * Searching  Steps 

•••  Analyze  Concept  of  Request 

***  Assign  Search  Terms 
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(XNmPTJJil)  VOCABULARIES  (OOOT’D) 


Compound  Concepts 

Pr e -Coord inat ion 

Many  Mil  t i -word  Terms 
* * * Large  Vocabulary 
***  Better  Precision 
Used  for  Indexing 

Frequently  Encountered 
Concepts 

Complex  Specific  Concept 

Examples 

Aircraft  engines 
Central  heating 
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(XNIBDLLED  VOCABULARIES  (CCNT'D) 


* * * 


Compound  Concepts  (cont’d) 

Post -Coord inat i on 

* * * Single  Terms 

Snaller  Vocabulary 

* * * Better  Recal 1 

Grouping  Techniques 
Linguist  1 c 

* * * Exanpl e 

Aircraft  engines,  use 
Aircraft  and  Engines 

* * * Semant i c 

* * * Example 

Cardiac  failure 
use  Heart 
Output 
Be  1 ow 
Normal 


[Ibid] 
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***************t*tttt*****i^t 

* 

* 

; FBEE  TEXT 

: APPROACHES 

* 
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FREE  TEXT  APPROACHES 


No  Index-Search  List 

***  Indexers  May  Choose  Different  Classes 
Searchers  Have  No  Guidance 
***  Reduced  Recal  1 

Reduction  of  Relevant 
Material  Retrieved 
Uncertain  Precision 

Questionable  Relevance  of 
Retrieved  Material 
Limits  Generic  Searching 
Restricts  Browsing 
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FREE  TEXT  APPTOACHES  ((XNT’D) 


Terms  Taken  Directly  From  Text 
* * * Advantage 

No  Distortion  of  Author ' s W)rds 
***  Disadvantages 

***  Uncontrolled  Vocabulary  Size 
***  Greater  Search  Effort 
***  Tools  Required  to  Rectify 
***  Idiosyncrasies 
* * * Imprecision 
***  Misspellings,  etc. 


249 


THESACIRIIS 

SUPPCKT 


**t*****t******t***********tt**tt** 
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THESAURUS  SUPPORT 


Basic  Concepts  of  Thesauri 
* * * Roget  Type 

***  List  of  Synonyms 

Choice  of  A1 1 ernat ive  Wjrds 

* * * Example 

injury,  n.  harm,  sprain,  damage,  mutilation, 
blemish,  cut,  gash,  scratch,  stab,  bite,  fracture, 
hemorrhage,  sting,  bruise,  sore  , cramp,  trauma, 
abrasion,  burn,  swelling,  wound,  scar,  laceration, 
affliction;  see  also  pain. 


, Laird,  ^^bster  ’ s New^A^r  Id  Thesaurus,  Popular 
ibrary.  New  York,  NY,  1974.]  ^ 
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TOESAUeUS  SUPPCET  {COtJT'B) 


Basic  Concepts  of  Thesauri  (cont’d) 

***  Information  Storage  and  Retrieval 
Systems 

***  List  of  Descriptors  - Subject 
Headings 

Directs  to  Post able  Terms 
***  Implementations 

* * * Bound 

* * * Onl ine 


HXK  TO  SYSTEM-SPECIFIC  EXAMPLE  * * * 
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THESAURUS  SUPPORT  (OCNT'D) 


Thesaurus  Utilization 

* * * Synonyms  and  Near  Synonyms 

* * * Misspel 1 ings 
***  Abbreviations 

* * * Homographs 

***  Search  Enlargement 
Search  Restriction 
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IHESAIMJS  SUPPORT  (CONT'B) 


Synonyms 

* * * Examples 

Zinc  Coatings 
UF  Galvanizing 

Galvanizing 
USE  Zinc  Coatings 

Near  Synonyms 

***  Semantic  Overlap 
***  Exan^le 
Light ing 

USE  Illumination 


Viewpoints 

* * * Example 

Snoothness 
UF  Roughness 
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IHESAURUS  SUPFCKT  (CX3^’D) 


Misspellings  - Alternative  Spellings 
Treated  As  Synonyms 
Can  be  Difficult  to  Identify 
***  Incorporated  in  Online  Thesaurus 
***  Entry  Vocabulary 

* * * Examples 
Bound 

Caesium 
USE  Cesium 

Onl ine 

Ateliosis 

Atheist 

> Athelete 

Athemat  ic 
Ather ine 
Atherosclerosis 
Athlete 
Athrocyte 

HDCK  TO  SYSTEM-SPECIFIC  EXAVPLE  * * * 
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TI^ESAURUS  SUPPORT  (OCNT’D) 


Abbrevi at i ons 

Listed  as  Synonyms 

* * * Examples 
Au 

USE  Gold 
LA 

USE  Louisiana 
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THESAURUS  SUPPORT  (OOsTr’D) 


Homographs 

* * * Look  A1 ike 

* * * Sound  A1 ike 

***  Different  Meanings 

* * * Denoted  by: 

* * * Scope  Notes 
***  Example 

Mercury  (Metal) 
Mercury  (Planet) 

***  Alternative  Endings 

* * * Example 

Concentration 

Concentrating 

Madifiers 

* * * Elxampl  e 

Air  cleaner 
Vacuum  cleaner 

HXK  TO  SYSTEM-SPECIFIC  EXAVFLE  * * * 
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THESAURUS  SUPPC3RT  ((XNT’D) 


Search  Enlargement 
* * * Broader  Temis 
* * * Example 
Bread 

BT  Grain  Products 


* ♦ * 


Related  Terms 
* * * Example 
Gambia 
BT  Africa 
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THESAURUS  SUPPORT  ((XNT’D) 


Search  Confinement 
* * * Narrower  Terms 

* * * Example 

Medicine 
NT  Pediatrics 

***  Related  Terms 

* * * Example 

Sediment 
RT  Strata 

HDCK  TO  SYSIEVI- SPECIFIC  EXAVEPLE  * * * 


HXK  TO  DISCIPLINE-SPECIFIC  EXAV1PLE 
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THESAURUS  SUPPCei  (CXKT’D) 


Using  the  Bound  Thesaurus 

Select  Terms  to  Help  Design  Search 
Saves  Time 
Saves  Money 
Saves  Frustration 


* * * Algor i thm 

For  Each  Concept  Involved 

Refer  to  Access  Vocabulary 
Refer  to  Thesaurus 
Search  on  Broader  Terms 
* * * Search  on  Narrower  Terms 
Search  on  Related  Terms 
Determine  Boolean  Combinations 

HXK  TO  SYSTEM- SPECIFIC  EXAMPLE  * * * 

HOCK  TO  DISCIPLINE-SPECIFIC  EXAMPLE  * * * 
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THESAURUS  SUPPORT  (OOvlT’D) 


Using  the  Online  Thesaurus 
***  Shows  Post  able  Terms 

* * * Saves  Time 

* * * Saves  Money 

***  Saves  Frustration 

HOCK  TO  SYSTEVl- SPECIFIC  EXAMPLE  * * * 
HOCK  TO  DISCIPLINE-SPECIFIC  EXAMPLE 
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* 


* 


********t***t*********1^t********t**1^t**** 

* 

BIBLIOGBAFHIC  DATA  BASE  SEARCHING 

* 

***********  **t*t*************if*t*t****t** 
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TVfPES  / LEVELS  OF  SEARCH  LANGUAGES 


**t*t*t****i^tttt*tt***ttt**t*t****** 
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TYPES/UEVELS  OF  SEARCH  LANGfUAGES 


TABLE  OF  OCNTENTS 


Overview  of  Bibliographic  Data  Base  Searching 


Search  Languages 

Integrated  Combinations  of  Search  Languages 
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OVEE?VIElV  OF  BIBLIOGRAPHIC  DATA  BASE  SEAECHING 
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OVEE^mV  OF  BIBLIOGEE^AFHIC  DATA  BASE  SEARCHING 


User  Needs 

Retrieve  Facts  or  Information 
Convenient  Comnunicat ion  with  the  Syst 
Quick  Response  Time 


266 


OVERVIHV  OF  BIBLIOGRAPHIC  DATA  BASE  SEARCHING  ( CCNT  ’ D 


***  Language  Capabilities 

***  WIAT  Information  Is  Desired 

***  HCW  Information  Is  Retrieved 

***  Boolean  Operations 

Examples:  AND,  OR,  NOT 

***  Relational  Operations 

Examples:  EEt,  NE,  GT,  LT,  GE,  LE 

***  Help  Functions 

Error  Detection  / Correction 

Existence  of  Information  in  Data  Base 

***  Count  of  Occurrences  of  Information  in 
Data  Base 

***  Report  Generation  Capabilities 
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OVEEIVIBV  OF  BIBLIOGEFJAPHIC  DATA  BASE  SEARCHING  (OCNT  ’D 


* 


* 


* 


Concepts 

Different  User  Categories 
Require  Different  Language  Features 
Correlation  Between  Levels 
One  Root  Language  For 
Hierarchy  of  Search  Languages 
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SEARCH  LANGUAGES 
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SEARCH  LANGUAGES 


Procedural  Languages 

* * * Mist  Specify 

***  Wiat  is '\^^nted 

**•  How  to  Obtain  it 

***  Implementations 

**•  Batch  Languages 
* * * Bnbedded  Language 
***  Stand-Alone  Languages 
***  System  may  Support 

***  Miltiple  Host  Languages 

***  Miltiple  Search  Languages 

***  Characteristics 

***  User  is  Skilled  Progranmer 
***  Batch  or  Online  Mode 
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SEARCH  LANGfUAGES  (OCNT'D) 


Language  Style 

***  Sequential  Instructions 


***  Syntax  Conpatible  with 
Ho  s t Langu  ag  e 

***  Mixed  with  Host  language  or 
Subroutines  to  Host  Language 


( 
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SEARCH  LANGUAGES  ((XOT’D) 


Non -Procedural  Languages 

High-Level  Comnand  Language 

Designed  for  Non- Prog ramning  Users 

***  Complete  Language 
* * * Obtains  Data 
***  Manipulates  Data 

Independent  of  Data  Structures 

Language  Dependent  Builtin  Functions 

***  Help  Facilities 

***  Implementations 

***  Menu-Oriented  Languages 
***  Prompt -Or ien ted  Languages 
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SEARCH  LANGfUAGES  (OOSTT’D) 


Prompt -Or lent ed  Languages 
***  User  Friendly 

* * * User  Prompted 
* * * Ebtan^l es 

Granting  Access 

Please  Input  Your  Name? 
(User)  EavesTM 
Please  Input  Your 
Password 
(User ) .... 

Bulletin  Requests 

Do  you  '\A^nt  to  See 
Bulletin  dated  (04/15/84) 
(User)  Yes/NO 
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SEARCH  LANGUAGES  (OCNT’D) 


Help 

***  Displays  Systan  Comnands 
***  User  Chooses  Desired  Comnand 

Separate  Comnands  for 

• * * Search 
***  Reporting 

Search  Comnands 

* * * Free  Text  Query 

* * • Example 

Please  enter  System  Comnand 
(User)  "Data  Base  Management" 
63  items 

*•*  Selective  Field  Search 
HXK  TO  SYSTEM- SPECIFIC  EXAMPLE  * * * 
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SEARCH  LANGUAGES  (OCNT’D) 


Language  Construct 

* * * Condi t ions 

***  Relational  Conditions 

***  On  Data  Base  Fields 
* * * On  Text  Strings 
***  On  Numeric  Values 
***  Boolean  Conditions 

***  On  Relational  Conditions 

HXK  TO  SYSTEM- SPECIFIC  EXAMPLE  * * * 
Reporting 

***  Default  Reports 
***  Formatted  Reports 
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SEARCH  LANGUAGES  (CCNT’D) 


Example  of  Language  Construct  in  MADAM 
(Mil  tics  Approach  to  Data  Access  and 
Management,  University  of  Southwestern 
Louisiana,  Lafayette,  Louisiana) 

Please  enter  Next  Term  or  System 
Comnand? 

(User)  Select 

Please  input  Valid  Selection 
Criteria? 

(User)  Title 

Please  input  the  Query  for  Title? 

(User)  eq  "Data  Base” 

PI  ease  input  the  rest  of  the 
Query,  use  a semicolon  to  terminate 
the  Query? 

(User)  author  eq  ’’Date"; 

2 items 

Please  enter  Next  Comnand  or 
System  Command? 
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SEARCH  LANGUAGES  (OOsTT'D) 


* 


* 


Offline  Query  Language 
***  Formatted  Forms  Used 
***  Request  Filled  in  Form 

Special  Forms  for  Each  Request  Type 
User  Supplied  with  Forms 
User  Steps  in  Filling  Form 
***  Refers  Data  Dictionary 

* * * Finds  Data  Base  Field  Names 

* * * Fills  the  Form 

***  Sutanits  to  Data  Processing 
Organization 

***  Data  Processing  Organization 

* * * User  Form  Key  Punched 

* * * Processed 

***  Result  Report  Delivered 
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SEARCH  LANGfUAGES  (COST’D) 


Onl ine  Query  Language 

Designed  for  Display  Terminal 
***  Tabular  Syntax 
***  Tables  Constructed 
***  Partly  by  User 

***  Partly  by  System 

Sequence  of  Filling  Iranaterial 

***  Steps  in  Filling  Table 

* * * User  : Presses  a terminal 

function  Key 

***  System  : Displays  Skeleton 

Table 

***  User  : Table  first  column 

f i 1 1 ed  wi  th  file 
name 

* * * System  : Column  names  of 

file  filled  in  Table 


* t * 


User 


: Search  data  filled  in 
Columns 
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SEARCH  LANGfUAGES  (OCKT’D) 


* * * Same  Table  Used  for 

***  Retrieval 
* * * Reporting 

***  Selection  Conditions 

Relational  Conditions 

***  Help 

On  Request  All  File  Names 
All  Columns  of  Desired  File 

* * * Reports 

Table  Form  with  Column  Headings 
Ascending  / Descending  Sorting 

Support  for  Bui  It  in  Functions 

HXK  TO  SYSTHVI-SPECIFIC  EXAMPLE  * * * 
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SEARCH  LANGUAGES  (OaSTT'D) 


Coirput  er  - Ini  t iat  ed  Language 

***  Quest  ion  Modes 

* * * Single  Yes -No  Mode 
‘ * * Mil  tipi  e-Choice  Mode 

Entries  Are  Coranonly  Known  Identifying 
Terms  / Names  of  Objects 

Tree  Structured  Information  Retrieval 

***  Designed  Primarily  for  End  Users 
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SEARCH  LANGUAGES  (OCNT’D) 


***  Menu-Oriented  Languages 
***  Example 


+ 


+ 


The  type  of  citations  to  be  searched  is 
Enter  the  Line  Number 


1. 

Articles 

1 in  Journals 

2. 

Books 

3. 

Both  of 

Above 

4. 

None  of 

Above 

> > > 

1 
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SEARCH  LANGRJAGES  (COSTT'D) 


I 

The  access  key  to  be  selected  is:  I 

I Enter  the  Line  Number--  I 

I 1.  Title  I 

I 2.  Author  I 

1 I 

! 3.  Abstract  I 

I 1 

I 4.  Keywords  I 

! 5.  Date  I 

6.  None  of  these,  display  next  screen  I 

! >>>  1 I 

+ 1___ 
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SEARCH  LANGUAGES  (OCNT'D) 


I ; T 

I The  first  character  of  the  author's  last  namh 

Enter  the  Line  Number--  I 

1 I 

I 1.  A B I 

I 2.  C D I 

I 3.  E F I I 

I 4.  H I J K I 

! 5.  L M N I 

I I 

I 6.  None  of  these,  display  next  screen  I 

I > > > 2 1 

I I 

+ ^ 
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SEARCH  LANGfUAGES  (OCNT’D) 


+ 

The  author's  name  is: 

Enter  the  Line  Number- - 
j 1.  Can,  E.  M. 

I 2.  Christian,  R.  W. 

I 3.  Codd,  E.  F. 

j 4.  Croft,  M.  F. 

I 5.  Date,  E.  A. 

6.  None  of  these  display  next  screen 

I > > > 5 


284 


SEAEOI  LANGfUAGES  (OasTT’D) 


+ 

1 

I Is  further  indexing  required? 

I Enter  the  Line  Number-- 

I 1.  Yes 

I 2.  No 

I > > > 1 
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SEAEOI  LANGfUAGES  (OCNT'D) 


+ 


+ 


The  Number  of  Desired  Records  is: 

5 

Do  you  want  to  see  the  list  of  records: 
Enter  Line  Number: 

1.  Yes,  on  the  screen 

2.  Yes,  print  the  list 

3.  Yes,  both  of  above 

4.  No 

> > > 3 





+ 
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SEARCH  LANGfUAGES  (OCNT’D) 


+ 


+ 


Indicate  preferred  output  format: 


Enter  Line  Numbers 

in  order-- 

1. 

Title 

7. 

2. 

Author 

8. 

3. 

Affiliation 

9. 

4. 

Journal 

10 

5. 

Date 

11 

6. 

Page  Number 

> > > 

1 2 4 5 6 7 

Volume  Number 
Issue  Number 
Abstract 


10.  Reference  Codb 

I 

11.  Category  Numbb 


+ 


+ 
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SEARCH  LANGfUAGES  (OCNT’D) 


Restricted  Natural  Languages 

***  Natural  Language  Input  with 
Syntactic  Restrictions 

***  Use  Keywords  and  Boolean 
Operations 

**•  Designed  for  End  Users 
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SEARCH  LANGUAGES  (CdsTT’D) 


Example 

Syntax:  select  < target  expression> 

v^ere  <qual if ication> 

select  articles  where  author  is  'DATE' 

and  title  cont 

DATABASE’  . 

« 

The  number  of  records  is  : 5 
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SEARCH  LANGUAGES  (OONT’D) 


Unrestricted  Natural  Languages 
* * * Synt  ax  Free  Natural  Language 
***  IWo-Step  Translation  Process 
Requires  Longer  Response  Time 
**•  Designed  for  End  Users 


Input 
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SEARCH  LANGUAGES  (OOsTr’D) 


* * * Example 


user:  please  give  me  the  number  of  articles 

vdiose  title  contains  'database'  and  is 
wr i 1 1 en  by  Da  t e . 

system:  Do  you  want  to  know  the  number  of 
articles  for  v^ich  the  author  is  "DATE" 
and  TAiiose  title  contains  database'?  If 

yes,  please  press  'return'  key; 

otherwise,  specify  your  specify  you 
request  again. 

user  : <return> 


system:  There  are  5 articles  written  by  Date  and 
"w^ose  title  contains  'database.'  Do  you 
want  to  see  the  list  of  the  articles?  If 
yes,  please  answer  yes,  otherwise,  please 
press  'return'  key. 

User:  yes 
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SEAEOI  LANGRJAGES  (OCNT’D) 


system:  Do  you  want  the  output  printed  on  the 
screen  or  on  a printout,  please  select  ont 
of  the  following  numbers: 

1.  on  the  screen 

2.  on  a print 

user:  1 

system:  The  following  is  a list  of  items  found  in 
an  article  record,  vihat  items  would  you 
like  to  print? 

Please  select  the  item  number (s)  you 
prefer  and  enter  them  in  order:  1.  title 

2.  author 

11.  categories 
user : 1235 
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SEARCH  LANGUAGES  (COSTT’D) 


system:  The  articles  are  : 


< information  > 


Do  you  want  to  get  a print  ? 

If  no,  please  press  'return'  key 

else, 

please  answer  'yes'. 


user:  < return  > 
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SEAECH 
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FEATURES 
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SEARCH  FIELD  OCNIRDL 


TABLE  OF  OOSTTENTS 


Search  Field  Control 

Single  Term  Searching 

Phrase  Searching 

Term  Proximity  Searching 

Term  Range  Searching 

Root  Searching 

Substring  Searching 

Thesaurus  Searching 

Dictionary  Searching 

Relational  Operation  Usage 

Search  Profiles  / Saved  Search  Strategies 

Request  Sets  / Search  Sets 

Search  Status 
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SEARCH  FIELD  OOsTmOL 


* 


* 


Text  Fields 
***  Title 

Series  Title 

* * * Abstract 

***  Subject  Heading 

* * * Publ isher 
***  Conference 

* * * Name 
***  Place 
***  MeSH  Subjects 

***  Medical  Subject  Headings 
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SEARCH  FIELD  OOSTTOOL  (OaSTT'D) 


Non-Text 

* * * Date 

* * * Author 

* * * Language 

* * * Issue  Number 

* * * Report  Number 

* * * Contract  Number 
***  Subject  Terms 

* * * Major  Terms 

* * • Minor  Terms 

* * * Library  Holding  Data 

***  Accession  Number 

* * * Dewey  Number 

* * * Library  of  Congress  Numbe 
***  Library  Location 
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SEARCH  FIELD  COSTIBOL  (OCNT’D) 


Variations 
***  Serials 

* * * Books 

***  Specific  File  Collections 
**•  Specific  Systems 

* * * HOCK  TO  SYSTEM- SPECIFIC  EXAMPLE 
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SINGLE  TEHVI  SEARCHING 


Single  Term  Searching 

***  Collective  Fields 

* * * Text 

* * * Non-Text 

***  Individual  Fields 


* * * HOCK  TO  SYSTEM-SPECIFIC  EXAMPLE 
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SINGLE  TEIM  SEARCHING  ((XNT’D) 


Stopwords 

* * * Too  Frequent  Occurrences 

* * * Ignored  for  Indexing  and  Searching 
***  Length  and  Coniposition  Varied 

According  to  System 


Exanpl es : 
the 
an 
to 
for 

Letters  of  the  alphabet 


HOCK  TO  SYSTEM-SPECIFIC  EXAMPLE  * * * 
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P«EIASE  SEAEKHING 


* * * Individual  Fields  Only 

* * * Direct  Entry 

* * * Con:5)ound  Term  in  Natural  Order 

* * * More  Like  Natural  Speech 

* * * Exan^le  : 

Spring  Operated  Locks 

***  Indirect  Entry 

***  Compound  Term  in  Inverted  Form 

* Class  Grouped  in  One  Place 

* * * Example  : 

Locks,  Spring  Operated 


HOCK  TO  SYSTEM-SPECIFIC  EXAMPLE  * * * 
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TEEM  PEMVnXIlY  SEARCHING 


Position  Checking: 

•••  Using  "Infix"  (adj,  (w) ) 

■ ’ * Exanples : 

SPACE  adj  SHUTTLE  (ORBIT) 

SPACE  (w)  SHUTTLE  (DIALOG) 

SE  (SCR  SPACE  SHUTTLE+e’FLIGHT) 
Order  of  terms: 

BEPCRE  <proximity>  JANUARY 

* * * Respect  Order 

BEPCRE  JANUARY 

* * • Any  Order 

BEPCRE  JANUAIS' 
JANUARY  BEPCRE 

HXK  TO  SYSTEM-SPECIFIC  EXAMETE  ’ * • 
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TEEM  PECKIMIIY  SEAEKHING  (CXKT'D) 


W)rd  Position  in  Some  Inverted  Files 
< ACCESS  NUMBER>  (position) 

SPACE  C’n’w)  SEIUTTLE 

is  equivalent  to: 

1/  SELECT  SPACE  AND  SHUTTLE 
2/  if  SHUTTLE(position) 

SPACE  (position)  = "n" 

then  Posting  = Posting  + 1 

***  Stop  W)rds  are  Usually  Included 
In  Assigning  Position 

No  W>rd  Position:  Search  a String 
SPACE  SHUTTLE 
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TEEM  PRQXIMnY  SEARCHING  (OCKT'D) 


Relative  Position 

If  W)rd  Pos i t i on  is  Very  Detai 1 ed 
< ACCESS  NL^CDEK>  < field,  phrase,  paragraph  > 
User  Can  Locate  Data  Within  Specific  Fields 
***  Within  a Field 

SETJEXJT  CCMFUTER  ( f ) ARCHITECTURE 
***  Within  a Phrase 
***  Within  a Paragraph 
***  Within  a Record 

SELECT  NUCLEAR  ( c ) ENGINEERING 
is  equivalent  to: 

SELECT  NUCLEAR  AND  ENGINEERING 
or 

SELECT  NUCLEAR;  SELECT  ENGINEERING; 

COVBINE  1 AND  2 
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TEEM  RANGE  SEAICHING 


***  Limiting  Search 

***  Reduce  the  Size  of  a Set 

***  Boolean  "AND"  and  "NOT" 

* * * Other  ^A^ys  System- Dependent 

HOCK  TO  SYSTEM-SPECIFIC  EXAMPLE  * * * 
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TEEM  RANGE  SEARCHING 


Limits  on  a Numeric  Field 

GREATER  THAN,  LESS  TEIAN,  FRCM  < . . . > TO 

* * * Range  of  Sets 

SEARCH  "Rl-RlO"  * (SPACE  SHUTTLE) 

* * * Range  of  Dates 

(H^JGINEERING  OR  PHYSICS) 

AND  YEAR  GREATER  THAN  1983 
Limit  Ccmnands 
***  A1  low  Restrict  ions 
on  a Broad  Search 
***  Date 

***  Type  of  Publications 
* * * Language 

(XMBINE  URANIIM  AND  LA/IRBSICH 
***  Country  of  Origin 

HOCK  TO  DISCIPLINE-SPECIFIC  EXAMPLE  * * * 
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TEEM  RANGE  SEAE5CHING  (CX^fT'D) 


* 


Update  Fields 

* * * Exists  in  Most  Records 

***  Frequency  of  Updates  Varies 

* * * Allows  SDI 

***  Convenient  Limitations  of  Search 
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BOCfT  SEARCHING 


Select  the  Stem  of  Each  Term 
***  Easy  Algorithm 

***  Many  Possible  Algorithms 
***  Check  Validity  of  Stems 
* * * Reduce  Index  Size 
***  Retrieve  More  Potentially 
Relevant  Items 
***  Beware  of  Large  Posting 
***  Slow 

***  Expensive  Search 
**•  Usually  Limited  by  System 
***  Keep  Extensive  Search 
as  Last  Resort 
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BOOrr  SEARCHING  ((XNT’D) 


Suffix  Strip 

PUBLISH 
PUBLISH!  ed) 
i.e:  PUBLISH!*):  PUBLISH!er) 

PUBLISH!  es) 
PUBLISH!  ing) 

HXK  TO  DISCIPLINE-SPECIFIC  EXAMPLE 


* * * List  of  Suffix 

***  Verbs,  Adverbs,  Plural 
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ROOT  SEARCHING  (CCNT'D) 


Prefix  Strip 

( chemo  )IHERAFY 
i.e:  (*)THERAPY:  ( electro  )TE€EE?AFY 

(psycho  jIHERAFY 

HOCK  TO  DISCIPLINE-SPECIFIC  EXAMPLE  * * 

* * * List  of  Prefixes 

Less  Frequently  Iirplemented 
* * * Complexi ty 
***  Less  Practical 
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SUBSTRING  SEAEOIING 


Search  of  a Term 
Ehibedded  Wi  thin  a Term 
***  Very  Useful  Tool 

To  Be  Used  Only  On  Subsets 
of  Data  Bases  (Selected  Sets) 

* * * Phrase  Searching 

***  if  Proximity  Not  Availabl 
CN(  * )LINE 
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SUBSTRING  SEARCHING  (CCNT'D) 


Wird  Truncation 

Size  of  Substring 
• ■ ‘ One  Character  : 

CAT( • ) ==>  CATS 

n"  Characters: 

CAT(2* ) ==>  CATCH 
Any  Characters: 

CAT( • ) ==>  CATS  . . . 

HOCK  TO  SYSTEM- SEBCIFIC  EXAMPLE  • ’ ‘ 
HOOK  TO  DISCIPLINE-SPECIFIC  EXAMPLE  ’ • • 
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SUBSTRING  SEARCHING  (CONT'D) 


Group  of  Concepts 

***  Universal  Character 

SELECT  COVIFUT?  (DIALOG) 

CCMPUT:  (CEBIT) 

OaVFUT$  (BRS) 

***  Various  Truncation 

***  Starting  Character(s) 

***  Trailing  Character (s) 

***  Einbedded  Character  (s) 
Using  Inverted  File 
Fragmented  "Words 
***  Beware  Irrelevant  Answers 

* * * Example  : 

CAT  and  CATERPILLAR 
***  Beware  Size  of  Sets: 

* * * Example  : 

CCN(*),  QSf(?).  MBTA($).. 
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THESAURUS  SEARCHING 


HCXK  TO  SYSTEM- SPECIFIC  EXAVIPLE  * * * 

History  of  NASA  Thesaurus 
***  Subject  Authority  List  (1962-1967) 
***  Uni  term  Concept 
***  Posting  Rules 
***  Major/Minor  Terms 

* * * r*lachine  Terms 
***  Singular  Version 

***  NASA  Thesaurus  (1968  to  Present) 
***  Joint  DOD-NASA  Development 

* * * Plural  Version 

***  16,713  Postable  Terms 

***  3,716  Non-Postable  Terms 

***  40,661  Ekitry  Terms 
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1HESAUE?US  SEARCHING  (OCNT'D) 


***  Search  Enlargement 
* * * Broader  Terms 
***  Related  Terms 
* * * Eixampl  e : 

Lungs 

BT  Anatoni^ 
Organs 
Respiration 
Viscera 
RT  Alveoli 
Bronchi 
Pleurae 
Spirometers 

HCXK  TO  DISCIPLINE-SPECIFIC  EXAMPLE  * * * 
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THESAURUS  SEARCHING  (OCOT’D) 


Search  Restriction 
* * * Narrower  Terms 
***  Related  Terms 
* * * Example  : 

Celestial  Bodies 
NT  Moon 

Satel 1 i tes 
RT  Light  Sources 
Lunar  Orbits 
Selenography 
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IHESAURUS  SEARCHING  ((XNT’D) 


Searchable  Fields 

* * * Major  Terms 

* * * Minor  Terms 

* * * Subject  Terms 

* * * HXK  TO  SYSTEM-SPECIFIC  EXAMPLE  * * * 

* * * HOCK  TO  DISCIPLINE- SPECIFIC  EXAMPLE 
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THESAURUS  SEARCHING  ((XNT’D) 


Expansion  Capabilities 

* * * Entry  Terms 

***  Alphabetical  Listings 
***  Spelling  Tolerance 
***  Entry  Vocabulary 

***  Not  All  Post  able  Terms 

* * * Thesaurus  Terms 

***  All  Postable  Terms 


HXK  TO  SYSTEM-SPECIFIC  EXAMPLE  * * * 
HOCK  TO  DISCIPLINE-SPECIFIC  EXAMPLE 
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DICriCNARY  SEARCHING 


Dictionary  Searching 

* * * Abstract  Field 
***  Oldest  Entries 

* * * Thesaurus  Search 

* * * Major  Terms 

* * * Minor  Terms 
Dictionary  Searching  Aids 
***  Historical  Files 

* * * Frequency  Comnand 


HOCK  TO  SYSTEM- SPECIFIC  EXAMPLE  * * * 
HOCK  TO  DISCIPLINE- SPECIFIC  EXAMPLE 
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RELATICNAL  OPE3E?ATICN  USAGE 


Boolean  Logic 

* * * General  Concepts 

OR  Links  Related  Concepts 
OIL  OR  PETEOLEIM 
AND  Links  Different  Concept 
OIL  AND  ENVIRCNVESTT 
Excludes  Some  Concepts 
ENERGY  NOT  OIL 

* * * Venn  Diagrams 
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REEATICNAL  OPEEATICN  USAGE  (CXKT’D) 


* * * 


Limits  of  Logic 

***  May  Obtain  Unexpected  Results 
May  Exclude  Relevant  Materials 
***  May  Retrieve  Irrelevant  Materials 


* * * Exanple 

SELECT  TNFX3EM^TICN  RETRIEVAL"  NOT  "QE®IT 
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RELATIONAL  OPEE?ATICN  USAGE  (OCNT’D) 

Inplied  Concepts 

* * * Expensive  and  Lengthy  Search 
***  Terms  in  Same  Hierarchy 

* * * Example 

SELECT  ’’LANGfUAGE"  AND  "FRENCH" 
Result:  Returns  Only  French 

References 

***  Specialized  Data  Base 

* * * Exanpl  e 

SELECT  "CHEMISTETi"" 

Result:  Returns  Too  Many 

Non-specific  References 
or  None,  Not  an  Index 
Term 

HOCK  TO  DISCIPLINE-SPECIFIC  EXAMETJE  * * * 
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SEARCH  PTOFILES  / SAVED  SEARCH  STE^ATEGflES 


***  One  Time  Search  vs.  Saving  a Search 

* * * A Query  Is  General  ly  Entered  One 
***  Occasionally,  A Searcher 
Repeats  Queries 
Within  One  Session 

On  Different  Data  Bases 
***  During  Different  Sessions 

On  Different  Data  Bases 
On  Same  Data  Base 
To  Check  Updates 
Repetitive  Use 
With  Snail  Variations 
Periodical  Execution 
To  Retrieve  Updates 
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SEARCH  PTOFILES  / SAVED  SEARCH  STRATEGIES  (OOSTT’D) 

Saving  Search  Strategies: 

***  Saves  Time 

Guarantee  Accuracy  of  Input 

Strategy  Developed  Once  For  All 
Typos  Corrected  Once  For  All 
Variation  of  a Search 
***  Reduces  Online  Stress 

Time  Pressure  Alleviated 
Allows  Batch  Processing 
* * * Cheaper 

Repetitive  Processing 
For  Checking  Updates 
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SEARCH  PTOFILES  / SAVED  SEARCH  STRATEGIES  (CXKT'D) 


• • * Saved  Search 

Current  Awareness: 

Need  for  Current  Information 
In  a Specific  Field 

• • • HXK  TO  SYSTEM- SPECIFIC  EXAMPLE  ■ ’ ’ 

• ■ • HXK  TO  DISCIPLINE-SPECIFIC  EXAMPLE  * ‘ * 
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SEARCH  PROFILES  / SAVED  SEARCH  STRATEGIES  (OONT'D) 


Saved  Search  (cont’d) 

Selective  Dissemination  of  Information 
***  Check  a Set  of  Queries 
***  Regular  Intervals 
***  Use  Updated  Fields 

* * * Frequency  of  Run  Is  System 

Dependent 

* * * Match  Can  Be  Exact  or 

Approximate 

***  SDI  Checks  Update  Fields 
***  Designed  for  Specific  Data 
Base  Only 

HOCK  TO  SYSTEM-SPECIFIC  EXAMPLE  * * * 

HOCK  TO  DISCIPLINE- SPECIFIC  EXAMPLE  * * * 
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SEARCH  PEOFILES  / SAVED  SEARCH  STE?ATBGIES  ((XNT'D) 

Searching  Different  Data  Bases 
***  Wiich  Data  Base  to  Select? 

* * * Frequency  of  Occurrence  of  a Term 
Indicated  in  Many  Data  Bases 
* * * Examples 
BRS-CBOSS 
DIALOG  - DIAL  INDEX 

* * * HDCK  TO  SYSTEM- SPECIFIC  EXAMPLE  * * * 
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SEARCH  PROFILES  / SAVED  SEARCH  STRATEGIES  (OCNT’D) 


Saved  Search  Strategies 

The  Cycle  of  Stored  Search: 

* * * Create 

* * * Save  / Name 

***  Edit  / Modify  / Update 

* * * Execute  or  Bypass 

* * * Delete 
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SEAEICH  PROFILES  / SAVED  SEARCH  STRATEGIES  (CXKTT 


Pre- Saving 

***  Specify  Intent  to  Save  Search  Strategy 

* * * Wien  to  Start  Saving  a Search 

***  Begin_Save,  Create,  End_Save , Execute 

* * * HXK  TO  SYSTEVl- SPECIFIC  EXAMPLE  * * * 

Post -Saving 

***  Enter  and  Execute  Queries 

***  All  Queries  Part  of  Stored  Search 
***  Terminate  Search  by  "Save" 
or  "End_3ave  ” 

***  Create,  End_Save , Execute 
HOCK  TO  SYSTEM-SPECIFIC  EXAMPLE  * * * 
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RBaUEST  SETS  / SEARCH  SETS 


Request  Sets 


***  Results  of  Queries 

* * * Automat  i c 

***  All  Session  Sets 
***  IVfenual 

* * * Choice  of  User 

***  Incorporate  in  Subsequent  Queries 

* * * Reasons 

* * * Reference 

* * * Print  Out 

* * * Save  Space 


HXK  TO  SYSTEM- SPECIFIC  EXAMPLE  * * * 
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RBQJUEST  SETS  / SEARCH  SETS  ((XNT’D) 


Search  Expression 
* * * Combines  Conmands 

WDrd,  Term  or  Set  Number 

* * * Root  or  Range  Searches 
***  Phrases  in  Text  or  Title 

* * * Mixture  of  A1 1 


HXK  TO  SYSTEM- SPECIFIC  EXAMPLE  * * * 
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SEARCH  STATUS 


Display  Simmary  of  Active  Request  Set 
***  Number  of  Retrievals  Per  Set 
***  Query  Wiich  Created  Set 


HOCK  TO  SYSTEM-SPECIFIC  EXAMPLE  * * * 
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SEARCH  STATUS  (COSTT’D) 


* * * Current  Status 

***  Session  Information 
Date 
* * * Time 

***  File  Collection 
***  Format  Specification 

User  Selected  Options  / 


* 


HXK  TO  SYSTEM-SPECIFIC  EXAIVffTE  * ‘ 


Parameters 
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OUTPUT  GENEE^TICN  FEATURES 
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OUTPUT  GENERATION  FPATUFDES 


TABLE  OF  CX^STTENTS 

Search  Review 

Predefined  Output  Formats 

User -Defined  Output  Formats 

Online  Vs.  Offline  Output  Generation 

Additional  Output  Generation  Features 

Printed  Index  Generation 
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SEARCH  REVIHV 


336 


SEARCH  REVIHV 


* 


* * 


Search  Request 

* * * Creates  Numbered  Set 

* * * Set  Contents 

* * * Number  of  Documents  Retrieved 

* * * Pointers  to  Documents 

***  Displays  Sunmary  of  Requested 
Sessions  Retain  Separate 
Col  lections 

* * * Search  Review  Lists  : 

* * * Number  of  Each  Set 

Number  of  Documents  Retrieved 

* * * Request  That  Created  Set 
***  History  of  Strategy 


Sets 

Set 
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PEIEDEFINED  OUTPUT  PQEMVT 


*************************** 
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PFIEDEFINED  OUTFOT  PQFMf^T 


f 


***  Defined  by  System 

* * * Contents 

* * * Exanpl  e 

Title 
Author 
Call  Number 

* * * Predetermined 

***  Minimum  Spacing  Between  Elements 
•**  First  Physical  Print  Position 
•**  Line  Size 

* * * Page  Size 

***  Column  Width  Equals 

* * * Length  of  Data 

* * * Length  of  Column  Header 

* * * Headings  Centered 

***  Underlined  at  Proper  Places 

* * * Sorted  Output 
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PEIEDEFINED  OLITPUT  FQEM^TS  (CCNT’D) 


* * * Example 


Reference  List 


Page  1 


Title 

Author 

Call  Number 

Distributed  Data  Bases 

H.  Schneider 

QA82.8.S97 

Information  Retrieval 

H.  Heaps 

Z699.H38 

^ Information  System 
Manifesto  ^ 

J.  Martin 

QA76  .WB27 

^ Introduction  to 
Data  Base  Systems 

C.  J.  Date 

QA76.9.D3D37 

^naging  the  Data  Base 
Env  1 r onmen  t 

j 

J.  Martin 

QA76.9.D3IVB6 

System  Defaul  t Format 
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USER-DEFINED  OUTPUT  POEM^TS 


341 


USER-DEFINED  OUTPUT  PQEMVTS 


* * 


Report  Content 

Select  Data  Elanents 
***  Choose  Strings 
* * * Coinpute  Values 
•**  Counts 

* * * Sub  Totals 
•**  Totals 

Title  and  Header  Suppressed  on  New  Page 
***  Choice  of 

* * * Default  Title 

* * * User  Defined  Title 
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USER-DEFINED  OUTPUT  PCSMVTS  (CCNT'D) 


* * if 


Data  Editing  Formats 
***  Specifications 

* * * Line  Size 
***  Page  Size 

***  Spacing  Factor 

***  Underlining  Character 

* * * Header  Width 

***  Header  Centering 

* * * Maximum  Page  Length 

***  Left  / Right  Justification 
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USER-DEFINED  OUTPUT  PQEMVTS  ((XNT'D) 


User 
* * * 

t * * 

* * * 


Created  Formats  Library 
Data  Editing  Formats 
***  Stored  on  System 
***  Named  with  Simple  Conmands 
Macros  Defined 
Library  Ccmnands 

***  Invoked  for  Desired  Display 
Report 

***  Modified  for  Changing  Demands 
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USER-DEFINED  OUTPUT  PCBEmTS  (OOSTT’D) 


* * * Example 


Data  Base  Systems  Sources 


Page  1 


Author 

Title 

Date 

Pages 

Date,  C. 

Introduction  to  Data  Base 
Systems 

1981 

675 

Heaps,  H. 

Information  Retrieval 

1982 

387 

Martin,  J. 

^ Information  System 
Manifesto 

1983 

456 

Martin,  J. 

Managing  the  Data  Base 
Environment 

1984 

780 

Nijssen,  G. 

Modelling  in  Data  Base 
Management  Systems 

1976 

366 

User  Defined  Format 
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CNLINE  VS.  OFFLINE  OUTPUT  GHSlEI^ATiasr 
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CNLINE  VS.  OFFLINE  OUTPUT  GINEBATIQN 


Online  Output  Generation 

Search  Requested  on  Interactive  Terminal 
***  Output  to  Interactive  Terminal 
* * * User  Review 

* * * Determines  Accuracy 

***  Satisfaction  with  Report  Format 
***  Modification  of  Output 

***  Search  Request  Modified  for 
Accuracy 

***  Format  Modified  for  Appearance 

* * * Repeat  Process 

* * * Accurate  Final  Output 


347 


ONLINE  VS.  OFFT,INE  OUTPUT  GENERATION  (CONT'D) 


* * t 


Sairple  NASA/F 


Language  Constructs 


display 

Syntax:  display  (set  number )/( format )/( range ) 
Query:  display  8/2/all 

Result:  All  Items  with  F\ill  Citation  (Format 
2)  of  Set  Number  8 Displayed  on  Screen. 


type 

Syntax:  type  (set  number )/( format )/( al  1 ) 
Query:  type  10/2/all 

Result:  All  Items  with  Full  Citation  (Format 
2)  of  Set  Number  10  Printed  on  Online 
Printer . 


* * * HOCK  TO  SYSTEM-SPECIFIC  EXAVIFTE  * * * 
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ONLINE  VS.  OFFLINE  OUTPUT  GBs(EE?ATICN  (OCNT’D) 

Offline  Output  Generation 

***  Output  at  Distant  Facility 

***  Data  Dictionary  Support 

***  Formulate  Search  Request 

* * * Accurate  Data  Field  Names 
***  User  Request  Sutmitted 

***  On  Prescribed  Form 
***  To  Retrieval  Center 
***  Output  Mailed  or  Delivered  at 
Faci 1 i ty 

* * * Time  Delay 

* * * HOCK  TO  SYSTEM- SPECIFIC  EXAMPLE  ‘ * * 
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ONLINE  VS.  OFETLINE  OUTPUT  G5>M^TICN  ((XNT’D) 


**  Coirparative  Analysis 
* * * Online 

Instant  Output  Checking 
***  Ccmnands  Modified  Real  Time 
***  Separation  of 

***  Screen  Review 
***  Print  Functions 
***  Offline 

* * * Time  Interval  for  Output 
***  No  Screen  Review 
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ADDITIONAL  OUTPUT  GENEEIATICN  FEATURES 
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ADDITICNAL  OUTPUT  GINEFIATICN  FEATURES 
Rapid  Scan 

Browse  Through  Retrieved  Records 
Before  Generating  Output 

Single  Field  Print 

Examine  Portion  of  Retrieved  Record 

* * * Example 

Title 

Subject  Terms 

Request  Output  of  Complete  Record 
Highl ight ing 

***  Display  of  Retrieved  Record 
Specific  Terms  Erphasized 

* * * Under  1 ined 

* * * Starred 

Sorting 

* * * Records  Ordered 

On  User  Chosen  Fields 

Ranking 

Record  Search  Terms 
Decreasing  Order  of  Frequency 
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PRINTED  INDEX  GENEEATICN 


tt****tt*tt*t**t*********t 
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PRINTED  INDEX  GiNERATICN 


Used  to  Access  Document  Collections 
Simplifies  Term  Classi f icat ion 
Functions  as  Thesaurus 
Saves  System  Time 

* * * Generated  Only  Once 

Facilitates  Fast  Search 

* * * Index  Terms 

* * * Documents  Indexed 
Generally  Large 

Good  for  Snail  Data  Bases 
***  Problem  for  Large  Data  Bases 
Choice  of  Indices 

* * * ha;ic 

* * * HADC 
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PRINTED  INDEX  GENEBATICN  ((XNT'D) 


* * * Kmc 

Key  W)rd  In  Context 
Titles  Repeated 

Alphabetical  Arrangement 
***  Keywords  Highlighted 
* * * Under  1 ined 
***  Double  Printed 
* * * Keywords  Centered 

Titles  Permuted  Around  Keywords 
***  Possibly  Truncated 

* * * Example 


t Laws  Itelating  to 
_ , Electronic 

e Legal  Aspects  of 


Computers  and  the 
cessing  (Of  Statute 
The  Patent 
Some 
The 


Processing  of  Statute  La 
CCMFUTER  Use  ^ 

OTdPpTE^  and  the  Law 
CCMFUTEES 

^^^JIRCNIC  Computers  and  the  Law 

L^VS  Relating  to  Computer  Use 
LEGAL  Aspects  of  Conputers 
PATENT  Laws  Relating  to  Computer 


[Heaps,  H.  S.  , , ^ Information 

Computational  and  Theoretical  Aspects 
Press,  New  York,  1978] 


Retrieval : 
, Academic 


355 


PRINTED  INDEX  GENERATICN  ((XNT'D) 


* * * moc 

* * * Keyword  Out  of  Context 

* * * Similar  to  KWIC 

* * * Keywords  at  Margin 

* * * Natural  W)rd  Order 


* * * Example 


OCMPUTER 

CCMFTJTER 

CQVIETOERS 

OCMTOERS 

ELECTRCNIC 

urn 

LAAB 

LEGAL 

PATENT 


Computer  Processing  of  Statute  Law 
The  Patent  Laws  Relating  to  Computer  Use 
Electronic  Computers  ana  the  Law 
Some  Legal  Aspects  of  Computers 
Electronic  Computers  and  the  Law 
Electronic  Computers  and  the  Law 
Computer  Processing  of  Statute  Law 
The  Patent  Laws  Relating  to  Computer  Use 
Some  Legal  Aspects  of  Computers 
The  Patent  Laws  Relating  to  Computer  Use 


[Ibid] 


* * * HXK  TO  DISCIPLINE-SPECIFIC  EXAMPLE  * * * 
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INSTRUCriCNAL  AND 


DIAGaOOSTIC  FEATURES 


357 


INSTRUCrriCNAL 

AND 

DIAGNOSTIC  FEATURES 


TABLE  OF  OCNTENTS 


Reference  Literature 
Online  Features 


Learning  Aids 


358 
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REFJbKhNCE  LITEEIATURE 


s System  Li  terature 

Catalogues  of  Sys t em  Fac i 1 i t ies 

Operating  Systems  Reference  Manual 

Data  Base  / IS&R,  Reference  Manual 

Programning  Languages  Reference 
Manuals 

Handouts  for  Beginners 
Handouts  for  Software  Tools 
W)rd  Processors 
* * * Text  Editors 


360 


CNLINE  FEATUEIES 


361 


ONLINE  FEATURES 


Online  System  Document  at  ion 

Brief  Description  of  System  Conmands 

Brief  Description  of  Error  Diagnostic 
Messages 

Via  "HELP " or  "EXFIAIN"  Coranands 

Online  Data  Base  Docianentat ion 

***  Brief  Description  of 
Accessible  Data  Bases 

***  Online  Training 

***  System  Tutorials  for  New  User 

Error  Diagnostic  Facilities 

Pre-execution  Error  Diagnostic  Message 
Execut ion- 1 ime  Error  Diagnostic  Message 
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LEARNING 


AIDS 


363 


LEARNING  AIDS 


Search  Logic  Tracing 


Detailed  Description  of  Retrievals 


Sample  Searches 

* • * HXK  TO  SYSTEM- SPECIFIC  EXAMPLE  * * * 
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LEARNING  AIDS  ((XNT’D) 


***  Example  of  Search  Logic  Tracing 

IF  Author  Ed  Lancaster’  AND  Abstract  OCNTAINS 
(’Information  Retrieval’  or  'Data  Base 
Software’  ) AND  DATE  GE  JANUAK!f,  1978 
THEN  DISPLAY  TITLE; 

Yields  0 Hits, 

Wiy  and  Wiat  to  do  Next  ? 


Search  Logic  Trace 


1.  Author  EQ  ’Lancaster’  15 

2.  Abstract  OCNTAINS  ’Information  Retrieval’  500 

3.  Abstract  (XNTAINS  Data  Base  Software'  10 

4.  Date  GE  January,  1978  10000 

5.  2 CR  3 505 

6.  1 AND  5 12 

7.  5 AND  4 100 

8.  1 AND  4 0 

9.  1 AND  5 AND  4 0 
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LEARNING  AIDS  (CX^TT’D) 


Solutions 


* * * 


For  Lancaster  Only  - 
Use  an  Earlier  Cut-Off  Dat 


* * * 


For  Recent  Documents  - 
Add  Other  Authors 
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LEARNING  AIDS  ((XNT  D) 

Live-help 

***  Accessabi 1 i ty  of  System  Consul  tan t 
***  For  Discussion 
***  Resolution  of  Difficulties 

Monitor  Log 

***  Record  of  User's  Interactions  with 
the  System 

* * * Provides  Feedback  to  the  System! 
Designers 

***  Provides  the  Foundations  for 

System  Performance  Measurement 
and  Evaluation 
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AEDITICNAL  IS«Jl  APPLICATICN  AREAS 


368 


ADDITIONAL  IS&R 
APPLICATION  AREAS 

TABLE  OF  OCNTENTS 

Selective  Dissemination  of  Information 
Support  for  Personal  Files 
Interfaces  With  Document  Delivery  Systems 
Combined  Retrieval  Systems 
Personal  Computing  Elnvironment 


369 


SELECTIVE  DISSBVUNATICN 
OF 

INPOEaiVnCN 
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SELECTIVE  DISSBVUNATICN  OF  INFXIEMVnCN 


Personal  Service 

Meets  Individual  Information  Needs 
Enploys  Individual  User  Profile 
Relevant  Data  Retrieved 
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SELECTIVE  DISSBVnNATICN  OF  INPCeVtVTiasr  ((XNT'D) 
Machine  Aided  Dissemination 
Partially  Automated 
***  Fully  Automated 
Existence  of  New  Literature 

Notification  to  Individuals  or  Group 
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SELECTIVE  DISSEVUNATICN  OF  INPQEM^TICN  ((XNT’D) 


Construction  of  User  Interest  Profiles 

***  Collect  User  Interest  Information 
Pertinent  Subjects 

***  From  Individuals 

* * * From  Groups 

***  Prepare  Query  Request  Profiles 
Similar  Clients 

Query  Retrieves  Current  References 


on 


for 
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SELECTIVE  DISSEVUNATiasr  OF  INFOEMVTIOSr  (OCNT’D) 

Modify  Interest  Profiles  to  Collect  Current 
References 

***  Periodically  Modified 

Quick  Reference  to  New  Material 

Search  Strategy 

Matches  User  Profiles  against  Documents 


374 


* * 

* * 

* SUPPORT  PCR  FPRSCNAL  FILES 

* * 

* ♦ 
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SUPPCKT  FOR  PEE^SCNAL  FILES 


Files  for  Specific  Projects 

Snail  Number  of  References 

Provide  for  User  Specification  of 

Data  Base  Definition 
***  Data  Base  Interrogation 

Data  Base  Report  Generation 

Data  Base  Update 

Data  Base  Redefinition 

Data  Base  Security  Considerations 

Stopwords  and  Keywords 
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SUPPORT  pce  PEE^SCNAL  FILES  (CXKT’D 


Combination  of  Bibliographic  and 
Management  Capabilities 

***  Stores  and  Retrieves 


t * * 


* * * Actual  Data 

* * * Analyzed  Data 

Statistical  and  Graphical 
Analysis 


Routines 


Data 


for 
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SUPPQE?r  FOR  PI 


ats»g#:i 


SAL  FILES  (Oa^’D) 


Character i st i cs 

***  Consistency  of  Comnand  Language 

Variety  of  Data  Types  and  Structures 
* * * Ease  of  Use 
***  Flexibility 

.*  * * Supports  Tutorial  and  Diagnostic  Aids 

Extensive  Interrogation  and  Output 
Functions 

Limited  User  Comnunity 
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SUPFQEn’  pce  PERSONAL  FILES  (OCOT’D) 


Characteristics  (Cont'd) 

*•*  Support  For 

***  Computational  Aids 

***  Statistical  Aids 

***  Report  Generation  Aids 
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SUPPORT  pce  PERSONAL  FILES  (OCNT'D) 


Examples 

Battel le’s  BASIS-70 
Stanford’s  SPIRES- I I 
Northwestern's  BIOS 
Mil  System’s  SYSTEM- 2000 
Southwestern  Louisiana’s  MVD/M 
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INTEUFACES 

WIIH 

DOCIMENT  DELIVEE^Y" 
SYSTEMS 


381 


INTEEIFACES  WITH  IX)CUVlENr  DELIVEECf  SYSTEMS 


Microform  Storage 

Equipment  for  Microform  Storage 
Retrieval 

* * * Mi  crof i Im 

* * * Mi  crof i che 

Large  Volume  of  Information  Stored 

Used  to  Store  Unchanged  Data 

* * * No  Rewr  i t i ng 

• • • No  Erasing 
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INTEE?FACES  WITH  IXKXIVlENr  DELIVEK!f  SYSTBVB  ((XNT’D) 


Paper  Copy  Produced  on  Demand 

Mi crof omi_t o_paper  Conversion  Device 
Every  Microfiche  Indexed 
Random  Access  Using  Index  Numbers 
Data  Viewed  on  Special  Reading  Equipment 
Microfilm  Copy  Can  Be  Developed 
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INTEEIFACES  WITH  DOCUVENT  DELIVERY  SYSTBVB  ((XNT'D) 
***  Video  Disks 

* * * Used  to  Store  Large  Volume  of  Data 

***  Approximately  1 Billion  Characters 
Large  Storage  Capacity  at  Low  Cost 
***  No  Rewriting 

« 

***  Mechanical  Duplication 


384 


OaVBINED 


RETRIEVAL  SYSTEM® 


385 


(XIVBINED  RETRIEVAL  SYSTBVB 

Interconnection  of  Information  Facilities 
***  Bibliographic 

Data  Base  Management 
***  Data  Analysis 
***  Citation  Indexing 
* * * Text  Processing 

User  Must  Understand 

Capabilities  of  Different  Systems 
Instructional  and  Diagnostic  Features 
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CXIVBINED  RETRIEVAL  SYSTBMB  ( Con t ’ d ) 


User  Retrieves 

Bibliographic  Textual  Data 
***  Numeric  Data 

Statistical  Analysis 
Comnon  Interface 


User  Formulates  Comnon  Language  Request 
Subnitted  to  Comnon  Interface 

Translated  to  Different  Internal 
Comnand  Languages 

User  Freed  frcm  Different  Ccmnand  Languages 
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PERSONAL  CCMPOTING 
ENVIRCNVESTTS 


388 


PERSONAL  CXMPOTING  EWIH3SMENTS 


Personal  Computer  Connected  to  Remote  IS&R 
Sy s t em 

User  ^Aforks  on  Personal  Computer 

Data  Retrieved  into  Personal  Computer  Storage 

***  Information  Downloaded 

Characteristics 

***  Reduction  of  Paper 

***  Flexible  Usage 

***  Avoids  Resource  Allocation  Probleams  of 
Large  Computer 
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PERSONAL  (XMFOTING  ENVIRCNVIENrS  (Cont  ’d) 


Functions 

***  Organize  Documents 

***  Search  Stored  Information 

***  Create  Local  Files 
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PERSONAL  COVDPUTING  ElWIRCNVIENrS  (Cont  ’d) 


Prestored  Procedures 

***  Login  and  Logout  to  IS^  System 

***  Sample  Searches 

Secur i ty 

* * * Access  Rights 

***  Checked  before  Downloading 

Personal  Computer  Files  Availabl 
to  A1 1 Users 

***  Copyrights 

Decentralized  Uncontrolled  Data 
***  Possibility  for  Violation 


391 


I S & R 

PEE^PQtM^CE  MEASURBVIENr  AND  EVALUATIOST 


392 


t 

* 

RVE  LIFE  CYCXE 

* 

* 

t****t*t*tt**t*******1^t******* 
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HVIE  LIFE  CYCLE 


TABLE  OF  COSTTENTS 

Basic  Concepts 

Define  Generic  Objectives 

Determine  Measurement  Parameters 

Select  Measurement  Tools 
Identify  Data  Analysis  Tools 

Design  and  Conduct  of  Experiments 

Perform  Data  Analysis  and  Evaluation  Activities 

Identify  and  Implement  Improvements 

Repeat  Cycle 
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*^*t*^***********t***t******** 


BASIC  OCNCEPTS 

t 

* 

t*t*t****t*******t*t****** 


* 

* 

* 

* * * * 
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BASIC  OCNCEPTS 


Purposes  of  FME 

Determining  Actual  Performance 
Projecting  Performance 
***  Improving  Capabilities  of  System 
Performance 

**•  How  Well  System  W)rks 

/ 

***  Equivalent  of  Value 

Subjective  Concept 

***  Objectively  Evaluated 

Measurement 

Act  or  Process  of  Measuring 
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BASIC  OCNCEPTS  (OCNT’D) 


* * * 


Evaluation 

***  Analyzing  Functioning  of  System 

* * * Analyzing  Usage  of  System 

***  Analyzing  Attainment  of 
Objectives 


Design 
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* * 
* 

* 

* 

* 

* 

* 

* 

« * 


* 


* 


* 


t 


* 

t 

DEFINE 

* 

GENERIC  OBJEXmVES 

* 

* 
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DEFINE  GENERIC  OBJECTIVES 


Environment  Definition 
***  Needs  Analysis 
***  Probl em  Def ini t ion 
***  Objectives  Defined 


Goals 

***  Measure  and  Evaluate 
Efficiency  of  System 


Execution 


399 


DEFINE  GENERIC  OBJECTIVES  (CCNT’D) 

Goals  ( cont ' d ) 

Measure  and  Evaluate  User  Interaction 
***  Identify  Usage  Patterns 

***  Identify  Error  Patterns 

***  Evaluate  User  Satisfaction 

* * * EJvaluate  User  Success 

Translation  to  Detailed  Measurement 
Parameters 
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DETEEMINE 

MEASUREMENT  PARAME7TERS 
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DETEEMINE  MEIASUREMENT  PARAMEJTEI?S 


Dictated  by  Generic  Objectives 
Objectives  under  Evaluation 

Ef f i c i ency  Measurement  Parameters 

* * * Response  Time 

* * * CPU  Time 
***  I/O  Time 

* * * User  Time 

***  Execution  Cost 
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MEASUREMENT  PARAMEHEHS  ((XNT’D) 

Usabi  1 i ty  Measurement  Parameters 
***  Completeness  of  Output 

* * * Total  Number  of  User  Errors 

* * * Number  of  Errors  of  Each  Type 

* * * Frequency  of  Errors 

***  Quality  of  Error  Diagnosis 

***  Quality  of  Error  Recovery  Assistance 

***  Complexity  of  Search  Language  Constructs 

***  Quality  of  Online  Training 

***  User  Ratings  of  Session 

***  User  Comnents  of  Session 
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MEASUREVDENT  PARAMEJTEE^S  (CXKT'D) 


Data  to  Support  Measurement  Parameters 


* * 


* * 


* * 


* * 


* * 


* * 


t * 


Session  Number 
Transaction  Number 
Date  of  Access 

CPU  Time  at  Start  of  Session 
File  Name  Accessed 
Total  Records  / W)rds  in  File 
Number  of  Records  Scanned 
User  Personal  Information 
Search  Text 

Entire  User  / System  Dialogue 
CPU  Time  at  End  of  Session 
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**************************************** 


• SELECrr  MEASUREMENT  TOOLS 

* 

* * 


\ 
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SEE.ECT  MEASUREMENT  TOOLS 


Potential  Measurement  Tools 

* * * Manual  Methods 

***  Questionnaires 

* * * Interviews 

***  Evaluation  Forms 

* * * Check  Lists 

* * * User  Comnents 

* * * Automated  Methods 

***  Hardware  Menitor 
***  Sof tware  Moni tor 
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SELECT  MEASURBVIENT  TTO  (CXKT’D) 
Characteristics  of  Measurement  Tools 

* * * Interference 

‘ * * Use  System  Resources 

Interfere  with  Sys t em  Operat ion 
Effect  System  Performance 

* * * Accuracy 

Sufficient  Precision  of  Variables 
Collection  of  Relevant  Data 

* * * Resolution 

Frequency  of  Recording  Data 

***  Cost 
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SELECT  MEASURBVEOT  TOOLS  ((XNT’D) 

Rank  and  Select  Measurement  Tools 
***  Based  on  Evaluation  Objectives 
Based  on  Characteristics  of  Tool 
***  Based  on  Support  For  Data  Collection 
***  Based  on  Suitability  to  Data  Analys 
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IDENTIFY  DATA 


ANALYSIS  ACTIVITIES 


**t**t*t**tif*****tt*t 
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IDENTIFY  DATA  ANALYSIS  TEXHNIQUES 


* 


Data  Analysis  Techniques 
***  Useful  for 

***  Organization  of  Data 
***  Interpretation  of  Data 
***  Frequency  Distributions 
***  Basic  Statistics 

* * * Mean 
***  Median 

* * * IVbde 

* * * Variance 

***  Standard  Deviation 
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IDENTIPY  DATA  ANALYSIS  TECHNIQUES  (OCNT’D) 

Advanced  Statistical  Analysis 
***  Test  of  Significance 
***  Analysis  of  Variance 
***  Regression  Analysis 

Data  Presentation  Tools 

***  Graphical  Representations 
***  Plots 
***  Scattergrams 
* * * Histograms 
***  Pie  Charts 
***  Tables  of  Results 
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DESIGN  AND 


OCNDUCTT  EXPERIMBNrS 


******t*t******t***t* 
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DESIGN  AND  CONDUCT  EXPERIlVIENrS 


Design  of  Experiments 

Develop  Pre-Usage  Questionnaires 
Develop  Post-Usage  Questionnaires 
Determine  Experiment  Duration 
Determine  Experimental  Environment 

Conduct  of  Experiment 

Activate  Automated  Performance 

Monitoring  Facilities 

Conduct  Pre-Usage  and  Post-Usage 
Questionnaire  Survey 

Perform  Appropriate  Data  Analysis 
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PEEIFQEM  DATA  ANALYSIS 
AND 

EVALUATION  ACTIVITIES 


*********************** 
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PEePQFM  DATA  ANALYSIS  AND  EVALUATION  ACTIVITIES 


Recall  and  Precision  Analysis 

***  Measures  Relative  Benefits  of  Types  of 
Indexing 

Title  Search  Versus  Abstract  Search 

Title  Search  Versus  Keywords  Search 

Title  Search  Versus  Full  Record 
Search 

Full  W)rd  Indexing  Versus  Substring 
Indexing 

**  Failure  Analysis 

Examines  How  Documents  Are  Indexed 
Examines  How  User  Request  Vi^s  Phrased 
Identifies  Appropriate  Search  Strategy 
**•  Makes  Comparisons 
Draws  Conclusions 
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PEE^POEM  DATA  ANALYSIS  AND  EVALUATICN  ACTIVITIES 


User  Assessments 

Overall  User  Success 
Overall  User  Satisfaction 

**  Error  Analysis 

Identification  of  Learning  Curves 

***  Comparison  of  Learning  Curves  with 
Previous  Experience 

Simple  Measures  of  User  Success 

Unit  Cost  (Time  Spent)  Per  Relevant 
Document  Retrieved 

Unit  Cost  (Dollars)  Per  Relevant 
Document  Retrieved 
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IDENTIFY  AND  WPLEMENT 
IIVIPROVEMENTS 
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IDENTIFY  AND  IME’LEMENT  EVlFTOVEJVlENrS 


Identify  System  Bot t 1 enecks 
Identify  User  Interaction  Problems 
Ident i fy  Measurement  Tool  Inprovements 
Improve  System  Execution  Efficiency 
Improve  Measurement  Tool  Capabilities 
Improve  EIxper imental  Techniques 
Improve  User  Overall  Success 
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♦ . * 
♦ * 

* REPEAT  HVE  CYCLE 

* * 

♦ * 

******t****tt*t******t****t***** 
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REPEAT  IME  CYCLE 


* 


* 


The  TOiole  Cycle  is  Repeated 
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TRADITIONAL  OBTRUSIVE 


USER  IVCNITCeiNG 

********************* 
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TEM)ITI04AL  OBIRUSIVE  VSFR  IVCNITQRING 


TABLE  OF  OCNTENTS 

Basic  Concepts 

Subjective  User  Assessments 

Use  of  Human  Subjects 

Controlled  Usage  Experiments 

Recall  and  Precision  Analysis 

Fa i 1 ur  e Ana lysis 

Data  Base  Coverage  Analysis 
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* * * * 
* 

* 

* 
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BASIC  OCMCEPTS  ' 


t 

*******t*****tift*t***tt****ttt* 


* * * 


* * * 
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BASIC  OCNCEPTS 


Monitors  Primary  Tasks 

***  Collection  of  Usage  Profiles 
***  Collection  of  Data  to  Support 

System  Performance  Evaluation 
Data  Base  Performance  Evaluation 

Improves  User  Productivity 

Optimizing  System  Performance 
***  Optimizing  Data  Base  Structuring 
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BASIC  OCNCEPTS(CCIvrr’D) 


Apparent  to  User 

***  Requires  User  Response 

***  User  Is  Aware  of  Monitoring 

Interference  with  Interaction 
* * * May  Interrupt  User  Thought  FI 
***  May  Inhibit  User  Actions 
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SUBJECTIVE 

USER 

ASSESSVJENTS 
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SUBJECrriVE  user  assessvjents 


Questionnaires  and  Ratings 

***  Content  of  Information 
***  Validity  of  Information 

Interactive  Comnents 

***  Interference  Effects 

***  User's  Motivation 

Usefulness  of  Interactive  Comnent 

***  Inmediate  Opportunity  for 
User  Feedback 

***  Identification  of  Comnon 
Problems 
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USE  OF  HUVKN 
SUBJECTS 
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USE  OF  HLMVN  SUBJECTS 


Psychological  Considerations 
***  Human  Percept  ion  Model  s 
***  Human  Behavior  Characteristics 
Variability  Control 

***  Psychological  Profiles  of  Groups 
***  Condensation  for  Differences 

Confidentiality  Considerations 

* * * Legal  and  Moral  Factors 

***  Impact  on  User  Actions 
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CXasriEOLLED 

USAGE 

EXPERIMENrS 
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(XNTROLLED  USAGE  EXFEREVENTS 


***  Design  Decisions 

***  Isolate  Factors  to  Be  Studied 
***  Identify  Contributing  Factors 
* * * Determine  Methods  of  Varying  Factors 


t * * 


Basis  for  Experimental  Grouping 

* * * Ability 

* * * Experience 
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(XNTROLLED  USAGE  EXPERllVlENrS  ((XNT'D) 


Control  of  Environment 
***  Identify  External  Factors 
***  Eliminate  Effect  or  Compensate 
Generalizing  Results 
***  Identify  Differences 
* * * Real  W)rld 

Experimental  W>r Id 
**•  Adjust  for  Differences 

***  Correlations  with  Real  W>rld 
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RECALL  AND  PRECISICN 
ANALYSIS 
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RECALL  AND  PRECISICN  ANALYSIS 


***  Recall  Analysis 

***  Recall  Ratio  = 

Number  of  Relevant  Documents  Retrieved 

X 100 

Number  of  Relevant  Documents  in  the  Data  Base 

RECALL  = (7/10)  X 100  = 70% 

« 

***  Precision  Analysis 

***  Precision  Ratio  = 

Number  of  Relevant  Documents  Retrieved 

X 100  Total 

Number  of  Documents  Retrieved 

PRECISIOSr  = (7/70)  X 100  = 10% 
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REC^^  Am  PElEriSiasr  (CX3NT  D) 

Recall  vs.  Precision 

Recall  and  Precision  Tend  to  Vary 
Inversely 

TYPICAL  RECALL/PE?EmSiasr  PLOT: 

1001 

I I 

RECALL  I I 


0 I 

0 100 


PRECISIOSr  RATIO 

Online  IS&R  Systeans  - Oriented  toward 
High  Precision 

Offline  IS&R  Systems  - Oriented  toward 
High  Recal 1 
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FAILURE  ANALYSIS 


t***^t*******T^tt** 
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FAILURE  ANALYSIS 


Correlation  to  Recall  and  Precision  Analys 
Analyze  Indexing  Accuracy 
* * * Analyze  User  Search  Strategy 
Feedback  for  System  In^rovements 
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* 

* 

; DATA  BASE  COVERAGE  ANALYSIS 

* 


* 

* 

* 

* 

* 

* 

♦ 
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DATA  BASE  COVERAGE  ANALYSIS 


Coverage  Definition  : 


Data  Base  Content 

X 100  All 

Relevant  Information 


* * * Problems 

Determining  Extent  of  "All  Relevant 
Information" 

***  Data  Base  Administrator 
Function 

***  Advice  from  Information 
Special ist 

***  Determining  Data  Base  Content 
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ADVANCED  UNDBIHUSIYE 


USER  M>IITCRINGr 
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ADVANCED  IJNOBIKUSIVE  USER  M3NIT0eiNG 


TABLE  OF  OCNTENTS 


Basic  Concepts 

Unobtrusive  Software  Monitoring  Facilities 
Quasi -Control  led  Usage  Experiments 
System  Usage  Profile  Analysis 
Timing  Analysis 

User  Error  and  Error  Recovery  Analysis 
Utilization  of  Results 
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* * 

* BASIC 

* * 

* * 

* OCNCEPTS 

* * 
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BASIC  CCNCEPTS 


Transparent  to  User 

Data  Collected  by  Software  Mon it 
Imbedded  in  System  Software 
* * * External  to  System 
No  Interference  with  Interaction 
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UNOBTRUSIVE  SOFITOFOE 


MCNITCeiNG  FACILITIES 


444 


UNOBTRUSIVE  SOFIV\5VRE  IVCNITORINGr  FACILITIES 
Parameters 

User  Error  and  Error  Recovery  Data 

* * * Error  Types 

* * * Error  Context 

User  Response  to  Error 
Subsequent  Error  Patterns 

Timing  Data 

System  Response  Times 

User  Response  and  Think  Times 

Retrieval  Logs 

* * * Extrapolate  Task  Success  from  Retrieval 
Success 

Display  of  Retrieved  Information 
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IMDHIBUSIVE  SOFTV^MIE  IVENITQRING  FACILITIES  (OCNT’D) 


***  Characteristics 

***  Levels  of  Transparency 

***  User  Aware  of  Monitoring 

* * * User  Repeatedly  \^^rned  about 
Monitoring 

***  Validation  of  Data 

***  Monitors  Mast  Recover  from 
Abnormal  Termination 

***  Rollback  of  Terminated 
Sequences 

***  Removal  of  Invalid  Data 
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IMDBraUSIVE  SOFI\;\ARE  IVENITQRING  FACILITIES  (OCKT’D) 


Software  Engineering  Techniques 

Usually  Applied  to  Standard  Software 
Systems 

Characteristics  Measured 

* * * Rel iabi 1 i ty 

***  Partially  Host -Dependent  in  I]E^^ 

* * * Correctness 

* * * Learnabi  1 i ty 

* * * Usabi  1 i ty 
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IMDBIRUSIVE  SOFIV^M?E  M>JITORING  FACILITIES  (OCOT’D) 


Characteristics  Measured  (cont'd) 

* * * FI exibi 1 i ty 

***  Modifiable 

* * * Portable 

* * * Performance 

* * * Appl i cabi 1 i ty 

***  Potential  for  User  Success 
***  Security  and  Protection 

***  May  Be  Host -Dependent 
***  Cost-Effectiveness 

* * * User ' s t ime 

* * * CPU  Time 
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QUAS I - CCNIBOLLED 


USAGE  EXPERIMENrS 
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QUASI-(XNIHDLLED  USAGE  EXPEREVENTS 

***  Subject  Grouping 

Based  on  Background 

* * * Based  on  Performance 
***  Experimental  Design 

***  Subjects  Given  Tasks  to  Perform 
***  Task  Performance  Uncontrolled 

* * * Measure  Success 
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QUASI-(X^^IC^IJL£D  USAGE  EXPERIMENTS  (OOSTT’D) 


* Definition  of  Tasks 

IV^st  be  Based  on  Patterns  in  Interaction 

***  Task  Termination  Defined 
***  Changes  in  Pattern 
***  Use  of  Terminating  Comnand 

Print  or  Display  of  Information 

* * * Usefulness 

* * * Measure  User  Success 

* * * Successful  Tasks  / Total  Tasks 

***  Time  Required  to  Complete  Task 

***  Comnands  Required  to  Complete 
Task 
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QUASI-(XNIEOLLED  USAGE  EXPERI]V!ENrS  (CONT'D) 


* Advantages 

***  Less  Demanding  on  Experimenter 
***  Can  Collect  Large  Amounts  of  Data 

* Di  s advan  t age  s 

***  Task  Determination  Problems 
***  Effect  of  Uncontrolled  Factors 


452 


SYSTBVI  USAGE 
PROFILE  ANALYSIS 
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SYSTEM  USAGE  PROFILE  ANALYSIS 


Ccjimiands  and  Features  Used 

Advanced  Users  Have  Greater  Range  of  Comnands 

Increase  in  Size  of  Active  Comnand  Set 

* * * Rapid  at  First 

***  Stabilizes  with  Time 

Correlat ions 

Complexity  of  Entire  Command  and 
F^inction  Set 

Availability  of  Milti-Level  Interfaces 
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SYSTEM  USAGE  PROFILE  ANALYSIS  {(XNT  D) 


Data  Bases  Utilized 

***  Det ermine  Wii ch  Data  Bases  Used 

IVfeasure  User’s  Frequency  of  Access 
Data  Bases 
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SYSTBVl  USAGE  PFJOFILE  ANALYSIS  (CCNT’D) 


Identifying  Typical  Patterns  of  Usage 

***  Determine  User  Classification 

Use  Monitor  Log  Information  for 
Other  Users  in  Same  Classification 

***  Compare  to  User’s  Past  Patterns 

Deviations  from  Pattern 

***  ^/fe,y  Indicate  Change  in  User  Category 

May  Indicate  User  Problem 
***  Identify  Problem  Type 
***  Possible  Re-training  Required 
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SYSTBVIUSAGE  PROFILE  ANALYSIS  ((XWD) 


Determine  User  Proficiency 

* * * Error  Levels 

***  Task  Accomplishment  Efficiency 

* * * Progress  over  Time 
***  Measure  Learnability 

***  Characteristics  of  Learning  Stage 
Utilization  of  New  Comnands 
***  Utilization  of  New  Features 
* * * Error  Hates 

***  Utilization  of  Help  Comnands 
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SYSTEM  USAGE  PROFILE  ANALYSIS  ((XNT'D) 


* 


* 


Identifying  End  of  Learning  Stage 

* * * Usage  of  New  Comnands  and  Features 

Tapers  Off 

* * * Less  Frequent  Errors 

***  Little  Use  of  Help  Comnands 

« 

* * * Process  Is  Repeated  As  User  MDves  to  New 

Interface  Levels 
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SYSTEM  USAGE  PROFILE  ANALYSIS  ((XNT’D) 


Measure  Usability 

***  Intact  of  Usability  on  Learnability 

***  Usabi  1 i ty  ^Measurement  s Are 
Primarily  Post -Learning 

* * * Parameters 

***  Memory  Retention  of  Comnands 
***  Cost  / Benefit  Analysis 
***  Task  Accomplishment  Analysis 


459 


TIMING  ANALYSIS 
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TIMING  ANALYSIS 


* * * 


* * * 


t * * 


System  Response  Times 

* * * Vary  with  System  Load 
***  Acceptable  Ranges 

* * * Vary  with  Task  Type 
***  Vary  with  Different  User  Types 
Time  / Cost  Analysis 

* * * Real  Time 

* * * CPU  Time 

User  Response  and  Think  Times 
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XJSER  ERRCR 
AND  ERBCfR 
REXX)VEE?bf  ANALYSIS 


462 


USER  EPECe  AND  EPECE  RECOVEPY  ANALYSIS 


Limi tat  ions 

Cannot  Measure  Logic  Errors 
Can  Measure  Syntax  Errors 
User  Motivation 

***  Information  Usually  Lacking 

Available  in  Controlled  Experiments 
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USER  ERROR  AND  ERROR  RECOVER!^  ANALYSIS  (CCOT  D) 


Parameters 

* * * Error  Rate 

Measure  Changes  over  Time 

* * * Types  of  Errors 

Identify  Coninon  Errors 

* * * Context  of  Errors 

***  Evaluate  Comnand  Series 
Use  of  Help  Conmands 

Indicates  Learning 
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USER  EPEQR  AND  EETRQR  BECOVEETf  ANALYSIS  (CO^  D) 


* * * Recovery 

***  Monitor  Activity  after  Error 

***  Decrease  of  Similar  Errors 
* * * Subsequent  Search  Success 

Implies  Successful  Help  Comnand 
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**************************************** 
* ♦ 

* * 

* UTILIZATICN  OF  RESULTS 

* * 

* « 

**************************************** 
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UriLIZATICN  OF  RESULTS 


Sy  s t em  Mod  ification 

Difficult  in  In^lemented  System 

***  System  Admini  St  rat  or  Function 

Modification  of  Data  Base 

Less  Difficult  than  System  Change 

May  Involve  Changes  at  Several  Different 
Levels 

***  Difficulty  Considerable 
Future  Design  Decision-Making 

Feedback  to  System  Designers 
***  Continuous  Cycle 
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FUTURE 

INPQEMVTiasr  STORAGE 
AND 

RETRIEVAL  SYSTEvB 
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FUTURE 

INPOeVI^TICN  STQE^AGE 
AND 

RETRIEVAL  SYSTBVB 

TABLE  OF  (XInTTENTS 

Languages  For  Retrieval 
A1  ternat ive  User  Interfaces 
PC  Environments 
Kn  owl  edge -Based  Systems 
Networks  / Distributed  Systems 
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LANGUAGES 

PCR 

RETRIEVAL 
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LANGFUAGES  FOR  RETRIEVAL 


Coimion  Comnand  Languages 

Multiple  System  Access 

One  Language  to  Learn 

***  Flexible 

Addition  of  New  Terms 
Addition  of  New  Features 
***  Sin5)ler  Hook-Up  Procedures 

***  Implementations 

***  Microcomputer  Front-End 
Intelligent  Terminals 
* * * Networks 
***  Mainframe  Processors 
Gateway  Systems 

Maximum  Ut  i 1 i zat  i on 
Easy  Retrieval 
Automatic  System  Switching 
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LANGUAGES  FOR  RETRIEVAL  ((XNT'D) 


Natural  Languages 

Informal  English  Format 
Large  Vocabulary 
***  Learning  Ability 

* * * Purposes 

* * * Aimed  to  Casual  User 

No  Specific  Knowledge 

* * * Advantages 

.*  * * Less  Training 

* * * Fewer  Errors 

Better  User/Machine  Interfac 

***  Disadvantages 

* * * Complexity 

* * * Time  Overhead 

***  Response  Slower 
***  More  Expensive 
***  Possible  Confusion 
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LANGUAGES  FOR  REHUIEVAL  ((XNT’D) 


Natural  Language  Requirements 

* * * Dictionary 

* * * Known  W>rds  / Terms 
***  Relationships 

* * * Syntax  Forms 

* * * Term  Syntax 

* * * Keywords 

* * * Stopwords 
***  Noisewords 

***  Semantics  Information 
***  Allowable  Forms 
***  Combinations 
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LANGUAGES  FOR  RETRIEVAL  (CX^STT’D) 


Special  Character  Languages 

A1  low  Retrieval  of  Non-Eiiglish  Document 

* * * Examples 

Chinese 

Arabic 

Russian 

Special  Symbols  Languages 

* * * Examples 

Mathematics 

Sciences 

Better  Retrieval  Performance 

* * * Improved  Hecal  1 
***  Flexible 


Needs  Special  Software  / Hardware 
Special  Graphics  Display 
Special  Keyboard 
Specific  Dictionaries 
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LANGUAGES  FOB  BETRIEVAL  (CXKT’D) 


Multiple  Purpose  Languages 

Integrate  IS&Rwith: 

***  Statistical  Packages 
***  Graphics  Packages 

* * * Text  Processors 
***  Utilities 

***  Provide  Comnon  Environment 

* * * Retrieve  Data 

* * * Process  Data 
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***»*♦***♦*»***♦***♦♦*♦************** 
* * 
^ AT  nrrmniL^  t a rrtr^ 
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ALTERNATE 

USER 

INITKFACES 


***************ift*****t:fftt******* 


* * * * 
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ALTERNATE  USER  INTERFACES 


Graphics  Displays 

***  Iirprove  Man  / Machine  Interface 
***  Better  Quality  of  Image 
***  Output  Formats 
***  Different  Colors 

***  Picture  Displays 

***  Video  Disk  Technology 

* * * Microfilm 

* * * Increased  Cost 

* * * Device  Cost 

* * * Host  CPU  Time 
***  More  Effective 

* * * Keeps  User  Interest 

* * * Increases  Performance 

***  Displays  Variety  of  Symbols 
***  Alternate  Characters 
***  Special  Symbols 
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ALTERNATE  USER  INTEFJFACES  ((XOT’D) 


Graphics  Input  Devices 
***  No  Typing  Required 

No  Misspellings  / Errors 

* * * SI ow  Processing 

* * * User  Mist 

* * * Read  Screen 

* * * Select  I terns 

* * * Point  Screen 

* * * User  Devices 

* * * Light  Pen 

* * * Point  at  Screen 

* * * Mmse 

* * * Move  on  Table 
***  Finger -Touch 

* * * Touch  Screen 

Effective  for  Casual  Users 
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ALTERNATE  USER  INTEKFACES  ((XNT’D) 


Voice  / Text  Recognition 

Highly  Advanced  Interfaces 

Still  in  Experimental  Form 

Voice  Recognition 

Allow  Oral  Conrauni  cat  ion 
***  No  Typing  or  Pointing 
***  Science  Fiction 

***  Text  Recognition 

Machines  Can  Recognize 
* * * Typed  Text 
**•  Hand-V^itten  Text 

Already  Elxisting  Devices 
***  Optical  Character  Reader 
**•  Special  Pens  / Tablets 
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ALTEEMATE  USER  INTERFACES  (OOSTT’D) 


TV  and  Video  Interfaces 


* * * 


* * * 


* * * 


Display  Stored  Images 

Display  / Retrieve  Specialized  Document 

* * * Pictures 

* * * Diagrams 

* * * Drawings 
***  Plans 

Need  Advanced  Technology 
Video  Disk  Storage 
Microf i Im 


* * * 


* * * 


t t t 


Best  with  Document  Delivery  Systems 


* * * 


t * * 


User  Sees  Full  Text 
User -Se 1 ec tabl e Parts  Only 
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* * « * 
* 

* 


* 


* 


* 

* 

♦ * # * 


PC 

ENVIRCNVlENrS 


* « * 
♦ 
* 

* 

« 

* 

* * * 
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PC  ENVIBCNVIENrS 


Considerations 


* * * 


Intelligent  Terminals 

Limited  Local  Processing 
No  Store  / Load  Operations 
No  Stand-Alone  Configuration 

Pc-Based  Interfaces 

Good  Local  Performance 
Store  / Load  Possible 
Stand-Alone  Configuration 


* * * 


« * « 


Advantages 

Non-Special ized  W)rks tat  ions 
Comnon  Conmand  Languages 
Easier  Connect  Procedures 
* * * Cost  Benef i t 

Good  Availability 


* * * 


* * * 


* * * 


face 
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KNOAOIDGE 

BASED 

SYSTEMS 


tt*****t* 
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KNCVILEDGE  BASED  SYSTEMS 


Intelligent  Gateways 

***  Automatic  System  Select  ion 

***  Automatic  Database  Selection 
No  Need  for  Manual  Dial-Up 
No  Need  to  KhowWiere 
Information  Resides 

* * * Network  Schemas 

Ccmnon  Comnand  Languages 

***  Automatic  Translation 
One  Interface  Only 

* * * Reduced  Training 

* * * Reduced  Expenses 

PC-Based  Workstations 
Hang-Up  after  Retrieval 
***  File  Transfer 

***  Automatic  Term  Addition 

System  Can  Learn  New  Te 
***  Cotimon  Dictionaries 
Private  Dictionaries 
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KNOALEDGE  BASED  SYSTEMS  ((XNT’D) 


Natural  Languages 

* * * Advantages  of  Learning  Systems 
* * * Sy s tern  Is  Able  to: 

* * * Correct  Errors 

***  Correct  Misspellings 

Syntax  / Semantic  Query  Errors 
Give  Better  Error  Messages 

9 * * * In^rove  Man  / Machine  Interface 

Other  Kn  owl  edge -Based  Applications 

Query  Optimization 

Best  Performance  Queries 
References  to  Previous  Queries 

***  User  Advising 

*•*  Online  Help 

***  Online  Training 

Intelligent  Diagnostics 
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KNO^LEEDGE  BASED  SYSTBVB  (CXKT’D) 


Knowledge  Representations 
* * * Frames 

***  All  Information  on  One  Entity 
***  Thesaurus  - 1 ike 
***  Rules 

Semantic  Relationships 
Syntax  Structure  Forms 
***  Transition  Networks 

***  Relationships  Between  Entities 
***  Possible  Combinations 


Processing 

* * * Traditional 

***  Regular  Programs 

* * * User-Created 
***  Comnercial  Products 

* * * Special  Cases 

* * * Inference  Engines 
***  Dedicated  Front-Ends 
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DISTRIBUTED 
AND  NEIIW3RK 
SYSTEVB 


***«**««**« 
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DISTRIBUTED  AND  NEHVIORK  SYSTEMS 


Network  Configurations 

* * * Star 

* * * Ring 

* * * Bus 

Network  Sizes 

* * * Local  Area  Networks 

* * * Large  Networks 

***  International  Networks 

Hardware 

***  Special  Network  Processors 
***  Coranuni cat  ions  Processor 
***  Front -Ekid  Processor 

* * * Data  Links 

Software 

***  Distributed  Data  Bases 

***  Access  Control 

***  Conversion  Protocols 
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DISTRIBUTED  AND  NETOOEiK  SYSTEMS  ((XNT’D) 


Local  Data  Bases 

***  No  Need  for  Remote  Dial-Up 

* * * Reduces  Cost 

* * * Data  Sources 

***  Mb,inframe  Downloading 
***  Locally  Developed 


Local  / Remote  Processing 
***  Flexible 
***  Process  on  Site 
* * * Process  Remote 
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ATTACHMENT  3.6 


COURSE  DEVELOPMENT  PHASE: 
FIRST  DRAFT  OF  PROPOSED 


COURSE  LESSON  PLANS 


I NASA  I 


I NASA  I 


♦♦****»*»******♦»»*»***♦****»*»**»»»***♦***»»*****»***«*» 


NASA  / RECON 

COURSE  DEVELOPMENT  SERIES 


FIRST  DRAFT: 
PROPOSED  COURSE 
LESSON  PLANS 


The  NASA/RECX)N  Course  Development  Series  contains  a collection  of 
draft  course  development  deliverables  representing  draft  results 
of  the  educational  course  development  activities  being  conducted 
pursuant  to  the  specifications  of  National  Aeronautics  and  Space 
Administration  Contract  Number  NASW-3846. 

The  entries  within  this  series  are  in  "draft**  form;  they 
represent  work  in  progress  and  work  in  various  stages  of 
revision.  As  such,  they  should  not  be  construed  as  final 
products  nor  should  they  be  viewed  as  material  for  widespread 
distribution.  All  entries  within  this  series  will  be  subjected  to 
multiple  development  phase  revisions,  to  course  pilot 
administration,  and  to  final  course  pilot  evaluation  and  final 
revision  prior  to  being  distributed  as  final  course  deliverables. 


For  more  information,  contact: 
Wayne  D.  Dominick 
Edi tor 

NASA/RECON  Course  Development  Series 
Computer  Science  Department 
University  of  Southwestern  Louisiana 
P.  O.  Box  44330 
Lafayette,  Louisiana  70504 
(318)  231-6308 


I COURSE  I 


I DEVELOHvlENT  I 


Course  Overview 


1 . 
2. 

3. 

4. 
5 . 
6. 


7. 

8. 
9. 

10. 
11  . 
12. 

13. 

14. 


Conventional  Research  Tools 
Information  Retrieval  Using  Computers 
User  Categorization 
Data  Mode  1 s 

Logical  Data  / Physical  Storage 

Structures 

Data  Base  Definition 
Data  Base  Interrogation 
Data  Base  Interrogation 
Data  Base  Report  Generation 
Data  Base  Update 

Data  Base  Redefinition  / Administrative  Functions 
Data  Base  Security 
Data  Base  Security 
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Performance  Measurement  & Evaluation 


15. 
16  . 

17  . 

18  . 
19  . 
20. 
21  . 
22. 
23  . 

24. 

25. 

26. 
27. 
28  . 


29. 


30. 
31  . 


****  TESTl  »»** 
Bibliographic  Data 
Bibliographic  Data 
Bibliographic  File 
Bibliographic  File 
Vocabulary  Control 
Vocabulary  Control 

Vocabulary  Control 

« 

Vocabulary  Control 
Bibliographic  Data 
Bibliographic  Data 
Search  Formulation 
Search  Formulation 
Search  Formulation 
Search  Formulation 
Search  Formulation 


Base  Design 

Base  Design  / Return  Test 
Structures 


St  rue  ture  s 


Base  Searching 

Base  Searching 

Features 

Features 

Features 

Features 

Features 
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32. 

33. 

34. 


35. 


36. 


37. 
38  . 
39. 


40. 


41  . 

42. 

43. 


44. 


45. 


46. 


47. 

48. 


Search  Fo rmu lation  Features 
*»**  TEST2  **»» 

Output  Generation  Features 

Output  Generation  Features  / Return  Test 

Instructional  & Diagnostic  Features 

Additional  IS&R  Application  Areas 

Additional  IS&R  Application  Areas 

Phases  of  the  FME  Life  Cycle 

Phases  of  the  PME  Life  Cycle 

Traditional  Obtrusive  User  Monitoring 

Traditional  Obtrusive  User  Monitoring 

Unobtrusive  User  Monitoring 

Unobtrusive  User  Monitoring 

Futures 

Futures 

Futures 

FINAL  EXAMINATION  **** 
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LESSON  PLANS 


CLASS  NO.  1 

SUB.IECT  Course  Overview 

TOP ICS  Survey  of  Course  Material,  Objectives,  and  Policies 
TIME  1 hour 

MAJOR  QBJECTIVE(S):  To  provide  a brief  explanation  of  the 

information  to  be  presented  and  the  work 
expected  from  the  students  in  the  coming 
s erne  s t e r * 

^RECiriC  OBJECTIVES: 

1.  The  students  will  be  exposed  to  the  major  topics  to  be  covered 
in  the  course. 

2.  The  students  will  understand  the  class  policies  on  grading, 
attendance,  testing,  etc. 

3.  The  students  will  be  informed  of  the  schedule  of  class 
act i vi t i e s . 

4.  The  learners  will  be  able  to  identify  the  systems  to  be 
studied. 

AESQVRCE  MATERIALS  NEEDED: 

1 . Visuals 

2.  Instructor  policies  handout. 
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RECCMVENDFD  READINGS  : 
None 


QUTSTANPING  HCMEV^ORK:  None  . 

ACTIVITIES: 

— -SlUPENT  ORIENTED— 

1 . Note-taking 
2 . Di s cus  s i on 

— INSTRUCTOR  ORIENTED— 

1.  Foil  presentation 

■SUMMARY  QE  LESSON: 

The  lesson  will  present  a brief  overview  of  the  course  material 
and  the  policies  of  the  instructor. 


FOCAL  POINTS  (test  areas): 
1.  Participating  systems. 


INSTRUCTOR’S 


NOTES 
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LE-SSQN  PJLANS 


2 

S-UPJECT  Conventional  Research  Tools 

TQP Reference  Tools,  Card  Catalogue,  and  Library 
TIME  1 hour 

MAJOR  OBJECTIVE(S) : To  motivate  the  study  and  use  of  automated 

research  tools. 


SPECIFIC  OBJECTIVES: 

1.  The  learner  will  understand  the  difficulties  of  performing 
manua 1 research. 

2.  The  learner  will  be  able  to  locate  specific  material  in  the 
s choo 1 1 i brary . 

3.  The  learner  will  appreciate  the  length  of  time  required  to 
conduct  library  research. 

4.  The  learner  will  be  familiar  with  the  physical  arrangement  of 
his  school  library. 

&ESQVRCE  MATERIALS  NEEDED: 

1 . Visuals 

2.  Free  Government  leaflets 
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RECOMvIENDED  READINGS  ; 
None  . 


Outstanding  assigisments:  None . 

ACTIVITIES: 

— STUDENT  ORIENTED— 

1 . Note-taking 

2 . Di scuss ion 

— INSTRUCTOR  ORIENTED— 

1.  Foil  presentation 

2.  Examples  of  complexity  of  conducting  manual  searches 
■SUVMARY  QE  LESSON: 

The  lesson  will  present  the  difficulties  of  manual  research  and 
familiarize  the  student  with  the  physical  layout  of  his  school 
library. 
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ZQCAL  POINTS  (test  areas) 

1.  Reference  tools. 

2.  The  Card  Catalogue 

INSTRUCTOR'S  NOTES 


LESgQN  PLANS 


CLASS  3 

SUBJECT  Information  Retrieval  Using  Computers 

TOP ICS  Use  of  computers  for  conducting  research 

TIME  1 hour 

MAJOR  OB JECTIVEC S ) : To  provide  a general  picture  of  the  variety 

of  systems  in  use. 


^SPECIFIC  OBJECTIVES: 

1.  The  learner  will  be  able  to  identify  the  uses  of  information 
sy  s t ems  . 

2.  The  learner  will  be  able  to  recognize  some  major  information 
s y s t ems  • 

3.  The  learner  will  understand  some  of  the  advantages  of 
automated  information  retrieval. 

BESQURCE  MATERIALS  NEEDED: 

1 . Visuals 

2.  Comparison  of  Systems  Handout. 
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RECCMvlENDED  READINGS: 
None 


OUTSTANDING  ASSIGNMENTS : None . 
ACTIVITIES: 


1 . No t e- 1 aki ng 

2 . Discussion 


— JNSTRUCTQR  ORIENTED— 

1.  Foil  presentation 

SUMMARY  QE  LESSON: 

The  lesson  will  present  some  major  information  systems, 
histories,  and  some  advantages  of  computerized  research. 


their 
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JQCAL  POINTS  (test  areas): 

1.  Advantages  of  computerized  systems. 

2.  Types  of  data  bases. 

3.  Comparison  of  conmands. 

INSTRUCTOR  » S NOTES 
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LESSON  PLANS 


CLASS  NQ^  4 

SUBJECT  User  Categorization 

TOPICS  Rationale,  Categorization  Parameters,  and  Category 

Definitions 

TIME  1 hour 

MAJOR  OBJECTTIVEC S ) : To  justify  multiple  user  categories  and 

define  the  different  types  of  users  of 
information  systems. 

SPECIFIC  OBJECTIVES: 

1.  The  learner  will  understand  that  information  systems  must 
serve  the  needs  of  a heterogeneous  population. 

2.  The  learner  will  be  able  to  identify  and  define  different 
classes  of  users. 


EESOURCE  MATERIALS  NEEDED: 
1 . Vi sua 1 s 
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JlECXTvMENDED  READINGS: 

Information  Retrieval  System  (chapter  23)  by  F.  W.  Lancaster. 

Analysis  and  Design  of  Information  Systems  (page  10-11)  by  J.  A. 
Senn . 

OUTSTANDING  ASSIGNMENTS:  None  . 

ACTIVITIES: 

—STUDENT  Q&IJENTED" 

1 . Note-taking 
2 . Di sens  s ion 


— INSTRUCTOR 

1.  Foil  presentation 

2.  Examples  of  different 


QE  LESSON; 

The  lesson  will  discuss 
rationale  behind  their 
of  each  user  category. 


type 

of  users 

the 

different  user 

r equ 

requirements,  and  the 

dif  f e 

irements,  the 
rent  functions 
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FOCAL  POINTS  (test  areas): 

1.  User  requirements. 

2.  User  functions. 


3.  User  categories. 

4.  Needs  of  each  category  of  users 
INSTRUCTOR’S  NOTES 
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lesson  2LANS 


CLASS  NQ^  5 
SUB .TECT  Data  Models 

TOPIC  Data  Models 

TIME  1 hour 


MAiJQR  QBJECriVE(S)  : To  identify  different  data 

designing  info  rma  tion  storage 
s y s t ems • 


mo  dels  in 
and  retrieval 


SPECIFIC  OBJECTIVES: 

1.  The  learner  will  understand  the  basic  concepts  of  data 
mode  1 ing . 

2.  The  learner  will  be  exposed  to  the  different  data  models. 


3.  The  learner  will  understand  the  similarities 
between  data  models. 


and  differences 


RESOURCE  MATERIALS  NEEDED: 
1 . Visuals 
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ED  READINGS : 


Computer  Data-Base  Organization  (chapter  1,2, 3, 6)  by  James 
Mart  in . 

Database  Management  by  Editorial  Staff  of  Auerbach  Publishers 
Inc  . 

Om:3TANPING  ASSIGhMENTS:  None  . 

ACTIVITIES: 


— ^STUDENT  ORIENTED— 

1 . No t e- 1 ak i ng 
2 . Di scus  s ion 

— INSTRUCTOR  ORIENTED— 

1.  Foil  presentation 

QL  LESSON: 

The  lesson  will  discuss  the  characteristics  of  the  different  data 
models.  Also  will  present  the  similarities  and  differences 
between  data  models. 


17 


FOCAL  POINTS  (test  areas): 

1.  Similarities  and  differences  between  data  models. 
INSTRUCTOR'S  NOTES 
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LESSON  PLANS 


■CLASS  NQ^  6 

sup JFCT  Logical  Data  and  Physical  Storage  Structures 

TX?P IC  Logical  Data  and  Physical  Storage  Structures 

TIME  1 hour 

M^JQR  OB  JECrriVE(  S ) : To  introduce  the  concepts  of  logical  and 

physical  data  structures  and  accessing 
methods . 


-SPECIFIC  OBJECTIVES : 

1.  Understand  the  concepts  of  logical  and  physical  structures. 

2.  Understand  the  definition  of  each  level  of  logical  data 
s t rue  ture  . 

3.  Understand  the  hierarchy  of  logical  data  structure. 

4.  Understand  the  data  representation  and  characteristics. 

5.  Understand  storage  structures. 

6.  Understand  accessing  techniques. 

RESOURCE  MATERIALS  NEEDED: 

1 . Visuals. 

2.  Comparison  Handouts. 
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RECOv^MENDED  READINGS: 


Computer  Database  Organization  by  James  Martin. 

Database  Management  Systems  by  Leo  J.  Cohen. 

Database  Management  by  the  Editorial  Staff  of  Auerbach  Publishers 
I nc  . 


OUTSTANDING  ASSIG 


'S  : None 


ACTlVmES; 


--STUDENT  QJUENTED— 

1 . Note-taking 

2 . Discussion 


--JNSTRUCTOR 


1.  Foil  presentation 
SlMVl^JRY  QE  LESSON: 


The  lesson  sumnarizes  the 
structure  levels.  It  also 
structures  and  introduces  the 
access ing  technique  s • 


logical 

discus 

concept 


da  t a s 
ses  the 
s of  data 


rue  t ur e s 
phy s i ca 1 
r epr e s en 


and  data 
storage 
ation  and 
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^OCAh  POINTS  (test  areas): 
L,  Data  structure  levels. 


t.  Data  representation. 

1.  Storage  structuring  techniques. 
i.  Accessing  techniques. 


LESSQN  PLANS 


CLASS  NO, 

7 

SUBJECT 

Da  t a 

Base 

De  finition 

TOPIC 

Da  t a 

Base 

Definition 

TIME 

1 ho 

ur 

MAwJOR  QB.TECTIVE(S)  : To  give  student  an 

e 1 erne nts  related  to 
database . 


idea  of  the  different 
the  process  of  defining  a 


■SPECIFIC  OBJECTIVES: 

1.  The  learner  will  understand  concepts  behind  data 
non— r edundancy , data  consistency,  and  data  independence. 

2.  The  learner  will  understand  schema  and  subschema  definition. 


RESQVRCE  MATERIALS  NEEDED: 
1 . Visuals. 
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RECQVMENDED  READINGS  : 


Computer  Data-Base  Organization  by  James  Martin. 

Introduction  to  Information  Systems  Development  (chapter  9)  by 
James  A.  Senn. 

OUTSTANDING  ASSIGbMENTS:  None . 

ACTIVITIES: 

--STUDENT  ORIENTED-- 


1 . No t e t ak  i ng 

2.  Discussi on . 


— INSTRUCTOR  ORIENTED— 

1.  Foil  presentation. 

QE.  LESSON: 

The  lesson  introduces  some  basic  concepts  about  data  base 
de  f i n i t i on . 
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FOCAL  POINTS  (test  areas): 

1.  Data  non-redundancy. 

2.  Schema  and  subschema 

3.  Data  indexing 

4.  Data  base  definition  languages 
INSTRUCTOR'S  NOTES: 
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lesson  plans 


CLASS  M).  8 

SUBJECT  Data  Base  I nterrogation/Searching 

TOPIC  Searching  Me  thods 

TIME  1 hour 


MAJOR  OBJECTIVE(S)  : 

Introduction  to  the  system  and  simple  search  techniques 

jSRJSCjriC  OBJECTIVES ; 

1 . Logging  in • 

2.  Basic  selection  constructs 

3.  Relational  expressions 


RESOURCE  MA^IERIALS  NEEDED: 

1 . Visuals. 

2.  Logging  in  instruction. 

3.  Homework  1. 
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RECOvt^lENDED  READINGS  : 

Information  Retrieval  Systems  by  F.  W.  Lancaster  (chapter  11). 
NASA/RECX)N  SYSTEM  user  manual  (chapters  1,  2 and  3) 

OUTSTANDING  ASSIGhMENTS  iHomeworh  1 
1 . Homework  1 

ACTIVITIES: 

— STUDENT  ORIENTED— 

1 . No t e- 1 ak i ng 

2 . Di s cu s s i on 

3.  Receiving  logon  id 

4.  Receiving  homework  1. 


— INSTRUCTOR 


1.  Foil  presentation 

2.  Assigning  logon  IDs  or  giving  instruction  on  how  to  get  them. 

3.  Assigning  homework  1,  due  at  class  11. 

■SLM^Y  OE  LESSON: 


Lesson  demonstrates  different  methods  of  interrogating  a data 
base. 
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FOCAL 


(test  areas): 


1.  logging  in 

2.  comparison  of  different  searches 

3.  relational  expression 

INSTRUCTOR’S  NOTES: 
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LESSON  PLANS 


CIASS  9 

SUB JECT  Da ta  Base  Interrogation/Searching 

TOP 1C  String  Ma  tching  and  Da  ta  Base  Searching  Language  s 

TIME  1 hour 


M^JQR  OBJECTIVE(S) : An  overview  of  the  different  searching 

technique  s . 


-SPECIFIC  OBJECTIVES; 


1.  String  matching  . 

2.  Existence  check. 

3.  Logical  Combinations. 


RESOURCE  MATERIALS  NEEDED: 


1 . 
2. 

3. 

4. 


Visuals. 

Te  rmina 1 . 

Usage  assig nme n t I . 

NASA/RECON  SYSTEM  user’s  manual. 
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RECC^ME^JDED  READINGS : 
NASA  RECX3N  User's  Manual 


OUTSTANDING  ASS  IGNMENTS  rHomewo rk  1; 

1.  Usage  assig nme n t I 

ACTIVITIES: 

— STUDENT  ORIENTED— 


1 . 

Not  e-taki 

^g- 

2 . 

Que  s t i ons 

about 

homework  1 

3 . 

Receiving 

usage 

ass  i gnment 

4. 

Getting  introduced  to  the 

— INSTRUCTOR  ORIENTED— 


Usage 


I . 

terminal  . 


1.  Foil  presentation. 

2.  Demonstration  of  1 

3.  Assigning  Usage  as 

4.  Answer  questions  a 

Q£  LESSON: 

Lesson  will  present 
languages.  It  will  i 
demonstration  of  the 


og-on  procedures, 
signment  I,  due  at  class 
bout  homework  1. 

boolean  logic  and 
ntroduce  the  RECON 
sys  t em. 


12  . 


data 

base  searching 

sys  t em 

along  with  a 
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fOCAL  POINTS  (test  areas) 

1.  Searching  Languages 

2.  Logical  combinations 


INSTRUCTOR’S  NOTES: 


LESSON  plans 


CLASS  NO. 

10 

SUBJECT 

Data 

Base 

Report  Generation 

TOPIC 

Data 

Base 

Report  Generation 

TIME 

1 hour 

MAJOR  objective ( S ) : To  know  about  the  Report  Generation 

Capabilities  of  information  storage  and 

retrieval  systems. 

SPECIFIC  OBJECTIVES: 


1 . 

The 

learner 

wi  1 1 

understand 

de  f au 1 

t report  format  . 

2. 

The 

1 earner 

wi  1 1 

understand 

fields 

of  a report  fo rma t . 

3. 

The 

1 earner 

will 

understand 

user  c 

reated  fo  rma  t s . 

RESOVRCE  MATERIALS  NEEDED; 

1 . Visuals. 

2.  NASA/ RECON  user’s  manual 
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RECCtVMENDED  READIhJGS; 

Analysis  and  Design  of  Information  Systems  by  James  A. 

The  Analysis,  design  and  Implementation  of  Information 
Henry  C.  Lucas,  Jr. 

Database  Management  by  the  Editorial  Staff  of  Auerbach 
OUTSTANDING  ASS  IGhMENTS  ; Homework  1 ; Usage  1 
ACTIVITIES: 

— STUDENT  ORIENTED— 

1 . Note-Taking . 

2.  Questions  about  assignments. 

3 . Di  s cus  s i on 

"■mSTRUCTQR  ORIENTED— 

1.  Foil  presentation. 

2 . Answe ring  of  questions. 


Senn . 

Sy  s t ems 

Inc  . 


^SIMvlARY  QL  LE&&QN: 

The  lesson  wi  11  carry  the  student  f r om  pe rf orming  a search 
presenting  him  with  different  methods  of  output. 


FOCAL  POINTS  (test  areas): 

1.  User  defined  report  format. 

2.  System  default  report  format. 

INSTRUCTOR’S  NOTES: 


33 


LESSON  PLANS 


CLASS  NO. 

11 

SUBJECT 

Data 

Base 

TOPIC 

Date 

Base 

TIME 

1 ho 

ur 

Mft^JQR  OBJECTIVE(S) : To  introduce  the  students  to  the  process  of 

data  base  update  and  access  controls. 

^ECinC  OBJECTIVES; 

1.  The  learner  will  recognize  the  factors  related  to  data  base 
update . 

2.  The  learner  will  understand  the  details  of  update  access 
control . 


RESQVRCE  MATERIALS  NEEDED: 
1 . Visuals. 
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RECQv-MENDED  READINGS; 

Computer  Data-Base  Organization  by  James  Martin  (1975). 


OUTSTANDING  ASS  IGNV1ENTS : Homewo  rk  1 (due);  Usage  1 
ACTIVITIES: 

— STUDENT  ORIENTED— 

1 . No t e- 1 ak i ng 

2.  Discuss! on 

3.  Turn  in  homework  1. 

— JUSSTRUCTQR  ORIENTED— 

1.  Foil  presentation. 

2.  Pick  up  homework  1. 

■SHvMUtY  QE  LESSON; 

Lesson  will  introduce  data  base  updating  operations 
procedure  s . 


and 
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£OCAL  POINTS  (test  areas) 

1.  Update  operation 

2.  Update  access  control 


INSTRUCTOR'S  NOTES: 


LESSON  PLANS 


class  12 

J ECT  Data  Base  Redefinition  and  Administrative  Functions 

TOPIC  Data  Base  Redefinition  and  Administrative  Functions 

TIME  1 hour 

M^JOR  QBJECTIVE(S) : To  introduce  the  students  to  the  process  of 

data  base  redefinition.  To  inform  the 
student  about  the  responsibilities  of  the 
system  administrator  and  the  data  base 
admini s t rator • 

SPECIFIC  OBJECTIVES: 

1.  The  learner  will  understand  the  reasons  and  justifications  for 
data  base  redefinition. 

2.  The  learner  will  see  examples  of  redefinition  languages. 

3.  The  learner  will  understand  the  system  administrator’s 
f unc  t i ons . 

4.  The  learner  will  understand  the  data  base  administrator’s 
f unc  t i ons • 

BESOVRCE  MATERIALS  NEEDED: 

1 . Visuals. 
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RECgvMENDED  READINGS: 


The  Analysis,  Design  and  Implementation  of  Information  Systems  by 
Henry  C . Lucas , Jr . 


Analysis  and  Design  of  Information  Systems  by  J.  A.  Senn. 
OUTSTANDING  ASSIGhMENTS:  Usage  1 (due) 

ACTIYmES; 

1 . Not e_taking . 

2.  Discussion. 

3.  Turn  in  Usage  assignment  I. 

■—INSTRUCTOR  ORIENTED-- 

1.  Foil  presentation. 

2.  Pick  up  Usage  assignment  I. 


.SHVMARY  QE  LESSON  L 

The  lesson  discusses  and  justifies  data  base  redefinition,  it 
also  takes  a close  look  at  the  functions  of  the  system 
administrator  and  the  data  base  administrator. 
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EQCAL  POINTS  (test  areas): 

1.  Need  for  data  base  redefinition, 

2.  Data  base  redefinition  Languages. 

3.  Functions  of  the  system  administrator. 

4.  Functions  of  the  data  base  administrator. 

INSTRUCTOR ^ S NOTES; 
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LESSON  PLANS 


CLASS  13 

SUBJECT  Data  Base  Security 

TOPIC  Physical  Pro t e c t i on , Au t hent i c a t i on , and 

TIME  1 hour 


Author i za t i on 


MAJOR  QBJECTIVE(S)  : To  identify  some  data 

considerations  and  make  a 
technologies  currently  in  use 


base  secur i ty 
survey  of  the 


SPECIFIC  OBJECTIVES: 

1.  The  learner  will  recognize  some  techologies  currently  used  in 
data  base  security. 

2.  The  learner  will  understand  how  authentication  and 
authorization  operate  in  a data  base  system. 


RESOURCE  MATERIALS  NEEDED; 

1 . Visuals. 
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RECgvMENDEP  READINGS: 

The  Analysis,  Design  and  Implementation  of 
Henry  C.  Lucas , Jr . 

Principles  of  Data-Base  Management  by  James 


OUTSTANDING  ASSIGbMENTS:  None  . 
ACTIVITIES; 


-"MUPENT 


1 . Note-taking 

2.  Discussion 


— INSTRUCTOR 


!•  Foil  presentation. 
SIM4ARY  QE  LESSON: 


Le  s s on 

presents  the 

sy  s t ems 

for  security. 

different  methods 


Inf  orma  t i on  Sy s t ems  by 


Mart  in . 


utilized  by  data  base 
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JFQCAl.  PQJJgS  (test  areas): 

1.  Definition  of  authorization. 

2.  Methods  of  authorization. 

3.  Definition  of  authentication. 

4.  Methods  of  authentication. 

5.  Physical  protection  techniques. 

lfc?gTRyCTQR  ^ S NOTES: 
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lesson  plans 


CLASS  IKLu  14 

SUB .1 ECT  Data  Base  Security 

IQPIC  Security  Logging  and  Secur i ty/Pr i vacy  Transformations 

TIME  1 hour 


MAJOR  OB  JECTIVE(  S ) : To  identify  s ome 

considerations  and 
current ly  in  use • 


data 

survey 


base  security 
the  t e chno 1 og i e s 


SPECIFIC  OBJECTIVES: 


1.  The  learner  will  recognize  some  technologies  currently  used  in 
data  base  security. 


2. 


The  learner  will  understand 
security/privacy  trans format  ions . 


secur i ty 


logging  and 


RESOURCE  MATERIALS  NEEDED: 


1 . Visuals. 
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RECOvf^IENDED  READINGS  : 

The  Analysis,  Design  and  Implementation  of  Information  Systems  by 
Henry  C.  Lucas,  Jr. 


Principles  of  Data-Base  Management  by  James  Martin. 


QUTSTANPING  ASSIGbMENTS:  None  . 
ACTIVITIES; 

"^STUPENT  ORIENTED— 


1 . No t e-t aking . 

2.  Discussion. 


-■mSTRUCTQR  ORIENTED— 


1 . 


Foil  presentation. 


-SI3MMARY  QZ  LESSON; 


The 
da  t 
the 


a 

s 


e 


lesson  compl e t e s 
base  systems  and 
p r o b 1 ems  . 


the  investigation  of 
the  technology  current 


security 
ly  in  use 


problems  in 
to  remedy 
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FOCAL  POINTS  (test  areas): 

1*  Different  techniques  used  for  data  base  security. 
INSTRUCTOR’S  NOTES: 
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L£S  SQti  PLANS 


CLASS  NO. 

15 

SUBJECT 

P e r f 0 rma  nee 

Me  a s u r erne  n t 

and 

Eva  1 ua  t i on 

TOPIC 

Pe  r f ormanc  e 

Me  a s u r erne  n t 

and 

Eva  1 ua  t i on 

TIME 

1 hour 

MAJOR  QB.TECTIVEC  S ) : To  introduce  basic  concepts  and  issues 

related  to  evaluating  IS  & R system. 


SPECIFIC 

1.  The  learner  will  understand  the  basic  concepts  of  evaluating 
I S&R  sy  s t ems  . 

2.  The  learner  will  learn  which  issues  will  affect  the 

performance  of  a IS&R  system. 

3.  The  learner  will  be  exposed  to  tools  used  to  evaluate  IS&R 
systems  . 


EE5QURCE  MATERIALS  NEEDED: 


1 . 
2. 


Visuals. 

Handout,  M^DAM  questionnaires 


46 


HECqvMENDED  READINGS  : 

Information  Retrieval  System  (chapter  14)  by  F.  W.  Lancaster. 

Analysis  and  Design  of  Information  System  by  J.  A.  Senn. 

The  Analysis,  Design,  and  Implementation  of  Information  Systems 
by  Henry  C.  Lucas. 

QVTSTANPINg  ASSIGISMENTS  : None  . 

ACTIVITIES: 

— STUDENT  ORIENTED— 

1 . Note-taking . 

2.  Discussion. 

— INSTRUCTOR  ORIENTED— 

1.  Foil  presentation. 

2.  Over  view  of  examination. 

SlMvIARY  QL  LESSON: 

Lesson  is  a brief  introduction  to  perf  o rmanc  e me  a s ur 
evaluation  which  will  be  discussed  in  greater  detail  la 


ement  and 
ter  . 
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FOCAL  POINTS  (test  areas): 

1.  Tools  and  techniques  used  in  performance  measurement  and 
evaluation. 

INSTRUCTOR  ’ 5>  NOTES  : 
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LESSON  PLANS 


CLASS  16 

SUBJECT  TEST 

TOPIC  User  Categorizations  through  Performance  Measurement  & 

Eva  1 ua  t i on 

TIME  1 hour 

MAJOR  QB  JECT1VE(  S ) : To  measure  the  student’s  grasp  of  the 

analysis  of  features  of  an  IS&R  system. 


SEECinC  OBJECTIVES; 

1.  To  measure  understanding  of  user  categorizations 

2.  To  measure  understanding  of  Data  Models 

3.  To  measure  understanding  of  Logical  Data  Structures 

4.  To  measure  understanding  of  Physical  Storage  Structures 

5.  To  measure  understanding  of  the  concepts  of  Data  Base 

Definition,  Data  Base  Interrogation,  Data  Base  Report 
Generation,  Data  Base  Update  and  Redefinition 

6 • To  me  a s ur  e under  standing  of  the  concepts  of  Da  t a Base 

Definition  and  Redefinition,  Data  Base  Interrogation,  Data 
Base  Update,  and  Report  Generation. 


&ESQURCE  MATERIALS  NEEDED: 
1 . Prepared  Test  1 
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yECavtyffM>EP  READINGS : 


Class  foils  for  lessons  1-15 

HCME^ORK  ASSIGKMENTS:  None  . 

ACTIVITIES: 

—STUDENT  ORIENTED— 

1 . Wr itten  test 

— INSTRUCTOR  ORIENTED— 

1 . Admi nister  test 

QE  LESSON: 

(Not  Applicable) 
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ZQCAL  POINTS  (test 
1.  (Not  Applicable) 

INSTRUCTOR’S  NOTES: 


areas ) 


lesson  plans 


IILA.SS  ml.  17 

SUB J ECT  Bibliographic  Data  Base  Design 

TOP IC  Bibliographic  Data  Base  Level  and  File  Design 

TIME  1 hour 


MA J QR  OB  J ECT I VE ( S ) : Introduction  to  the  bibliographic  data  base 

hierarchy. 


-SPECIFIC  OBJECTIVES: 

1.  The  learner  will  understand  the  hierarchy  of  bibliographic 
data  base  design. 

2.  The  learner  will  be  exposed  to  file  design  considerations  for 
a bibliographic  data  base. 


RESOURCE  MATERIALS  NEEDED: 

1 . Visuals. 

2.  Homework  2. 
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RECavMENDED  READINGS  : 


OUTSTANDING  AS  S I GhMENTS  : Home  wo  r k 2 
ACTIVITIES: 

—■STUDENT  ORIENTED— 

1 . No  t e - 1 ak i ng . 

2 . Di s cu s s i on 

3.  Receive  homework  2. 


— INSTRUCTOR  ORIENTED— 

1.  Foil  presentation. 

2.  Assign  homework  2 (due  at  class  20) 


jMyMAJRY  QL  LESSON: 

Lesson  turns  its  attention 
bibliographic  data  base.  It 
basic  features  of  this  type. 


to 
d i 


a spec  ia 
s cus  se  s 


1 type  of 
the  diffe 


data 

base  called 

rent 

1 eve  1 s 

and 
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ZQCAL  POINTS  (test  areas): 

1.  Bibliographic  data  base  levels. 

2.  Bibliographic  data  base  file  types  and  their  functions. 

INSTRUCTOR  NOTES: 
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LESSON  PLANS 


CLASS  18 

SUBJECT  Bibliographic  Data  Base  Design 

TOPIC  Bibliographic  Data  Base  Files 

TIME  1 hour 

M^JQR  OB JECTIVE( S ) : An  overview  of  the  types  of  files  used  by  a 

bibliographic  data  base. 

SPECIFIC  OBJECTIVES: 

1.  The  learner  will  understand  the  the  purpose  of  the  different 
files  used  in  a bibliographic  data  base. 

2.  Learner  will  be  made  aware  of  document  file  design 
considerations. 


RESOURCE  MATERIALS  NEEDED: 

1 . Vi sua 1 s . 

2.  Usage  assignment  II. 

3.  Handouts  showing  EXPAND,  COMBIISIE,  SELECT,  SET  STATUS. 
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Database  Design  (1977)  by  G.  Wi  ed e rho 1 d . 


QUT.STANP  I NQ  ASS  IGhMENTS  : Homework  2;  Usage  II 
Usage  assignment  II. 

ACTIVITIES: 

— STUPEMT  ORIENTED— 


1 . 

No  t e- 1 ak i ng 

2 . 

Di  s c u s s i on 

3 . 

Receive  usage  assig nme n t 

1 1 . 

4. 

Qu estions  about  h omewo r k 

2. 

— INSTRUCTOR  ORIENTED— 

1.  Foil  Presentation 

2.  Distribution  of  Usage  assignment  II. (Due  at  class  22). 

3.  Answering  questions  from  homework  2. 

4.  Distribution  of  handout  for  Usage  assignment  II. 

^IMVIARY  QL  LESSON: 

Lesson  looks  at  the  different  types  of  files  used  by 
bibliographic  data  base. 


the 
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ZQCAL  mum  (test  areas): 

Types  of  files  in  a bibliographic  data  base 

2.  Levels  of  data  base  organization. 

3 . Data  type  s . 


JKSTRUCTOR  > S NOTES: 


LESSON  PLANS 


CLA$S  19 

SUB .1 ECT  Bibliographic  file  structures 

TOP  1C  Linear,  Indexed,  and  List  Structured  File  Organizations 

TIME  1 hour 

MAJOR  OBJECTIVE(S) : To  give  a more  detailed  introduction  of 

bibliographic  file  structures  in  addition  to 
the  physical  storage  structure. 


SPECIFIC  OBJECTIVES: 

1.  The  learner  will  understand  the  basic  concepts  of  linear  file 
organi za t i ons . 

2.  The  learner  will  understand  the  basic  concepts  of  indexed  file 
organi zat i ons . 

3.  The  learner  will  understand  the  basic  concepts  of  list 
structured  files.  organizations. 


RESOURCE  MATERIALS  NEEDED: 
1 . Visuals. 
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READINGS : 

Information  Retrieval  Systems  (chapter  13)  by  F.  W.  Lancaster 

OUTSTANDING  ASS  IGhMENTS : Homework  2;  Usage  II 

ACTIVITIES: 


— STUDENT  ORIENTED— 


1 . No  t e- 1 ak i ng 

2 . Di s cu s s i on 

3.  Questions  about  assignments 


— INSTRUCTOR  ORIENTED— 

1.  Foil  presentation 

2.  Answer  questions  about  assignments. 


LESSON: 


on 

t ake  s 

a closer  look  at 

the  files  of 

a bibl iographic 

and 

di  scu 

sses  the  organizat 

ions  of  the 

different  type 

files. 


data 

of 
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FOCAL  POINTS  (test  areas): 


1.  Linear  file. 

2.  Indexed  file  organizations. 

3.  List  structured  file  organizations. 

INSTRUCTOR’S  NOTES: 
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LESSON  ELANS 


CLASS  NQ_^  20 

SUBJECT  Bibliographic  file  structures 

TOP IC  Tree,  Network  and  Clustered  File  Organzations 

TIME  1 hour 

MAJOR  OBJECTIVE(S) : To  give  a more  detailed  introduction  of 

bibliographic  file  structures  in  addition  to 
the  physical  storage  structure. 


^KClflC  OBJECTIVES; 

1.  The  learner  will  understand  the  basic  concepts  of  tree  and 
network  file  organizations. 

2.  The  learner  will  understand  the  basic  concepts  of  clustered 
file  organizations. 


RESOURCE  MATERIALS  NEEDED: 
1 . Visuals. 


61 


RECQVMENDED  READINGS  ; 

Information  Retrieval  Systems  (chapter  13)  by  F.  W.  Lancaster 
OUTSTANDING  ASS IGNVENTS : Homework  2 (due);  Usage  II 
ACTIVITIES: 

1 . Not  e-taking 

2.  Discussion 

3.  Turn  in  homework  2. 

— INSTRUCTOR  ORIENTED— 

1.  Foil  presentation. 

2.  Pick  up  homework  2. 

QE  LESSON: 

Lesson  completes  the  discussion  of  bibliographic  files 
organi zat ions . 


and 
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FOCAL  POINTS  (test  areas): 


1.  Tree,  network  and  clustered  file  organizations. 

2.  Tradeoffs  of  various  file  organizations. 

INSTRUCTOR'S  NOTES: 
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LESSON  PLANS 


CLASS  NCL-  21 

SUB J ECT  Vocabulary  Control 

TOPIC  Controlled  Vocabularies 

TIME  1 hour 


MAJOR  OB JECTIVEC S ) : To  introduce  the  concept  of  contr 

vocabularies  and  present  the  differ 
between  indexing  and  searching  of  sy 
which  employ  controlled  vocabularies 
those  which  do  not. 


^SPECIFIC  OBJECTIVES: 


To 

r e cpgni ze 

the  advantages  and  disa 

dvantage  s 

of  a cont 

vo< 

:abulary  in 

searching  a data  base 

To 

unders  tand 

that  a concept  may  be 

embedded 

in  several 

To 

under s tand 

that  not  all  terms  are 

pos table 

in  a cont 

vo< 

:abulary  sy 

s t em. 

RESOURCE  MATERIALS  NEEDED: 

1 . Visuals. 

2.  Access  to  NASA  RECON  terminals 

3.  NASA  RECON  User’s  Manual 


oiled 
ence  s 
s t ems 
and 


oiled 

erms  . 
oiled 
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REAPINg$; 


Vocabulary  Control  for  Information  Retrieval  by  F.  W.  Lancaster 
NASA  RECON  User’s  Manual 


OUTSTANDING  ASSIG 


’S  : Usage 


1 1 


ACTIVITIES: 


—STUDENT  ORIENTED— 

1.  Review  of  User’s  Manual 


--INSTRUCTOR  ORIENTED— 

1.  Foil  presentation 

QL  LESSON: 

Lesson  teaches  the  basic  concept  of  the  controlled  vocabulary  as 
an  influence  in  indexing  and  searching. 
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rOCAL  POINTS  (test  areas): 


1.  Controlled  vocabularies 

2.  Advantages  and  disadvantages  of  the  controlled  vocabulary 

3.  Co-ipound  concepts 

INSTRUCTOR’S  NOTES: 
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LESSON  PLANS 


CLASS  ML-  22 

SUBJECT  Vocabulary  Control 
TOPIC  Free  Text  Approaches 

TIME  1 hour 


MAJOR  OBJECTIVE(S) : To  identify  the  concept  of  free  text 

indexing/ searching  in  relation  to  IS&R 

SPECIFIC  OBJECTIVES: 


1 . To 

r ecogni ze 

the  advantage  s 

and  disadvantages 

of 

free  text 

search! ng  . 

2.  To 

under  s t and 

the  di f f er ence 

s between  control 

led 

vocabulary 

index/ search 

techniques  and 

free  text  index/se 

arch 

techniques 

RESOURCE  MATERIALS  NEEDED: 

1 . Visuals. 

2.  Access  to  NASA  RECON  terminals 

3 . Handout  s 

4.  NASA  RECQN  User’s  Manual 


67 


SECavMENPEP  READINGS  : 


Vocabulary  Control  for  Information  Retrieval  by  F.  W.  Lancaster 
NASA  RECON  User’s  Manual 

OUTSTANDING  ASSIG^MENTS:  Usage  II  (due). 

ACTTIVITIES: 

—■STUDENT  ORIENTED— 

1.  Discuss! on . 

2.  Note-taking 

3.  Turn  in  Usage  assignment  II 

—INSTRUCTOR  ORIENTED— 

1.  Foil  Presentation 

2.  Explanation  of  handouts 

3.  Demonstration  of  search  procedures 

4.  Pick  up  Usage  assignment  II 

SUVMARY  OF  I.KSSON: 

Lesson  demonstrates  the  problems  encountered  in  searching  records 
which  have  no  index-search  list.  Advantages  and  disadvantages 
are  discussed. 
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FOCAL  POINTS  (test  areas): 
1.  Free  text  searches 


INSTRUCTOR  » S NOTES: 
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LESSON  PLANS 


CLASS  23 

SUBJECT  Vocabulary  Control 
TOPIC  Thesaurus  Support 

TIME  1 hour 

MAJOR  QPJLCTIVE(S) ;T o identify  the  concept  of  a thesaurus  in 

relation  to  IS&R.  To  learn  basic  (bound  and 
online)  procedures  in  vocabulary  control.  To 
understand  the  advantages  of  a thesaurus. 

^SPECIFIC  OBJECTIVES: 

1.  To  understand  the  basic  concepts  of  the  thesaurus 

2.  To  demonstrate  an  ability  to  use  synonyms  in  searching 

3.  To  recognize  the  relationship  between  the  Roget  thesaurus  and 
IS&R  descriptors 

4.  To  understand  how  to  find  and  use  postable  terms 

RESOURCE  MATERIALS  NEEDED: 

1 . Visuals. 

2 . Ac  cess  to  NASA  RECON  t e rmi  na  1 s 

3 . Handout  s 

4.  NASA  RE  CON  User’s  Manual 


70 


■RECflyMENPEP  READINGS  : 

Vocabulary  Control  for  Information  Retrieval  by  F.  W.  Lancaster 


NASA  RECON  User’s  \Ianual 
OUTSTANDING  ASS IGNV1ENTS  : None  . 

ACTIVITIES: 

— .S.IUDENT  ORIENTED— 

1.  Review  of  Roget  thesaurus 

2.  Note-taking 

3.  Hands-on  experience  using  thesaurus  for  searching 

4.  Demonstration  of  ability  to  find  related  words  in  searching 

— INSTRUCTOR  ORIENTED— 

1.  Foil  Presentation 

2.  Explanation  of  handouts  (postable  terms) 

3.  Demonstration  of  searches 

4.  Monitoring  of  terminal  activities 

■S.\M1\RY  QE.  LESSON: 

Lesson  describes  the  purpose  and  the  use  of  subject  headings  and 
postable  terms  in  searching.  Reiterates  the  importance  of 
synonym  referencing. 
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>QCal 


(test  areas): 


[.  Identification  of 
t.  Identification  of 

[NSTRUCTOR’S  NOTES: 


po stable  terms 
descriptors 


2 


LESSON  PLANS 


■CLASS  24 

SUBJECT  Voc abu lary  Control 

TOPIC  The  saurus  Utilization 

TIME  1 hour 

MAJOR  OBJECTIVE(S) :T o identify  the  concept  of  a thesaurus  in 

relation  to  I S&R  s y s t ems  To  learn  s ome  basic 
(bound  and  online)  procedures  in  vocabulary 
cont  r o 1 


3FECIFIC  OBJECTIVES: 

1.  To  learn  to  utilize  synonyms  in  searching 

2.  To  learn  to  use  the  thesaurus  to  check  misspellings  and 
abbre vi a t i ons 

3.  To  use  the  thesaurus  for  identifying  homographs 

4.  To  demonstrate  understanding  of  search  enlargement 

5.  To  demonstrate  understanding  of  search  confinement 

RESOURCE  MATERIALS  NEEDED: 

1 . Visuals. 

2.  Access  to  NASA  RECON  terminals 

3.  Handouts 
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RECCMvlENDED  READINGS  : 


Vocabulary  Control  for  Information  Retrieval  by  F.  W.  Lancaster 
NASA  User’s  Manual 


OUTSTANDING  ASSIG 


rs : None  . 


ACTIVITIES: 


— STUDENT  ORIENTED— 

1.  Discussion  of  concepts 

2 . No te-taking 


— INSTRUCTOR  ORIENTED— 


1 . 
2. 
3. 


Presentation  of  foils 
Explanation  of  handouts 

Demonstration  of  search  expansion  and  confinement 


JSlMylAJtY  OH  LESSON; 

Lesson  teaches  the  usage  of  expansion  and  confinement  in 
facilitating  searches. 
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FOCAL  POINTS  (test  areas) 


1 . Use  of  EXPAND 

2.  Use  of  confinement 

3.  Related  te rms  usage 

INSTRUCTOR ’ S NOTES; 


LESSON  PLANS 


CLASS  NO.  25 

SUBJECT  Bibliographic  Data  Base  Searching 
TOPIC  Types/Levels  of  Search  Languages 

TIME  1 hour 

MAJOR  QB JECTIVE( S ) :To  identify  the  various  types  and  levels  of 

search  languages.  To  relate  the  use  of 
search  languages  and  bibliographic  data  base 
searching 


:S£ECIFIC  OBJECTIVES: 

1.  To  explain  the  content  and  dynamics  of  bibliographic  IS&R 
s y s t ems 

2.  To  present  the  rationale  for  hierarchy  of  search  languages 

3.  To  determine  user  needs  in  relation  to  search  languages 

&ESOURCE  MATERIALS  NEEDED: 

1 . Visuals. 


2.  Handouts  on  types  of  search  languages 


RECavMENDED  READINGS: 


“Information  Retrieval”  in  Database  Design  (2nd  Edition)  by  G. 
Wi  ederhold 

Data  Base  User  Languages  for  the  Non-Pr ogramne r , pp . 183  - 212, 

by  P.  C.  Lockemann 

Human  Interaction  With  Computers  by  H.  T.  Smith  and  T.  R.  G. 
Green 


Introduction  to  Modern  Information  Retrieval  by  G.  Salton  and  M. 
J . McGi  1 1 


Design  of  Man-Computer  Dialogues  by  J.  Martin 


OUTSTANDING  ASSIG 


rs : None 


ACTIVITIES: 

"jmjPENT  ORIENTED— 

1. Discussion  of  need  for  various  levels  of  languages 
2 .Not e-taking 

3 • I dent i f i ca t i on  of  user  needs 


"JNSTRVCTQR  ORIENTED— 

1. Foil  presentation 

2.  Lecture  on  brief  review 

3.  Explanation  of  how  to 


SUyMUlY  QL  LESSON: 


of  IS&R 
ident i f y 


system  languages 
user  needs 
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Lesson  establishes  the  foundation  of  search  language  concepts  in 
I S&R  systems.  Serves  as  lead-in  to  types  of  search  languages  and 
identification  of  user  needs. 
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FOCAL  POINTS  (test  areas): 

1.  Rationale  for  hierarchy  of  search  languages 

2.  Dynamics  of  search  languages 

INSTRUCTOR ’ S NOTES: 
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LESSON  PLANS 


class  26 

SUBJECT  Bibliographic  Data  Base  Searching 

TOPIC  Search  Languages 

TIME  1 hour 

MAJOR  OBJECTIVE(S) : To  differentiate  between  the  various  types  of 

search  languages  and  to  demonstrate 
integrated  combinat ions  of  these  languages 

SPECIFIC  OBJECTIVES; 

1.  To  explain  the  characteristics  of  Procedural,  Host-Based 

Languages 

2.  To  explain  the  characteristics  of  Self-contained  query 

1 anguage  s 

3.  To  explain  the  characteristics  of  Prompting  and  Form  Oriented 
languages 

4.  To  explain  the  characteristics  of  menu— s e 1 e c t i on  languages 

5.  To  explain  the  characteristics  and  usages  of  natural  languages 

RESOURCE  MATERIALS  NEEDED: 

1 . Vi  sua 1 s . 

2 » Handout  s on  languages 
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RECOMMENDED  READINGS: 

"Information  Retrieval”  in  Database  Design  (2nd  Edition),  pp . 
521-542,  by  G.  Wiederhold. 

Data  Base  User  Languages  for  the  Non-Prog  ranine  r , pp.  183-212,  by 
P.  C.  Locke rmann 

Human  Interaction  with  Computers  by  H.  T.  Smith  and  T.  R.  G. 
Green 

Introduction  to  Modern  Information  Retrieval  by  G.  Salton  and  M. 
J . McGi  1 1 

Design  of  Man-Computer  Dialogues  by  J.  Martin 


QUTSTANPINg  ASSIG] 


[5j_ 


None  . 


ACTIVITIES: 


—STUDENT 


1 

2 


Note-taking 
Di  s cus  s i on 


of  search 
ORIENTED— 


1 


anguage 


type  s 


1.  Presentation  of  foils 

2.  Explanation  of  handouts 

3.  Discussion  of  search  language  types 


SUMMARY  QL  LESSON: 


Lesson  presents  the  various  search  languages  available  on  IS&R 
systems  and  the  characteristics  of  each. 
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LESSON  PT,ANS 


CLASS  NO.  27 

SUBJECT  Search  and  Formulation  Features 

TOPIC  Search  Field  Control 

TIME  1 hour 


MAJOR  objective! S ) ;To  enable  students  to  conduct  online  searches 
SPECIFIC  OBJECTIVES; 

1-  To  implement  available  conmands  in  conducting  a search 

2.  To  understand  the  relationship  between  the  conmand  and  the 
entry  recovered 

3.  To  understand  the  use  of  Boolean  expressions 

4.  To  demonstrate  how  to  combine  conmands  for  search  expressions 


RESOURCE  MATERIALS  NEEDED; 

1 . Visuals. 

2.  Handouts  of  examples 

3.  NASA  RECON  User’s  Manual  (or  excerpts) 


/ 
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RECCM 


ED 


READINGS ; 


Introduction  to  Modern  Information  Retrieval  by 
McGi I I . 


NASA  RECON  User’s  Manual 


OUTSTANDING  ASSIG 


: None 


ACTIVITIES: 


--STUPENT  ORIENTED— 

1 . No  t e- 1 ak ing 

2.  Discussion  of  Boolean  concepts 

3.  Hands-on  experiences  in  conducting  searches 


--INSTRUCTOR  ORIENTED— 

!•  Foil  presentation 

2.  Explanation  of  handouts 

3.  Demonstration  of  Text  and  Non-text  fields 

4.  Monitoring  of  terminal  activities 

^UyM\RY  QE  LESSON: 


Lesson  demonstrates  text  and  non-text  field  control  in 


i 


Salt  on& 


s ear che  s 
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FOCAL  POINTS  (test  areas): 


1.  Title,  Series  title,  Abstract,  Subject  heading.  Publisher,  and 
Conference  searches 

2.  Differences  between  text  and  non-text  fields 
iJ^STRUCTQR  * $ NOTES: 


8S 


LESSQE  PLANS 


CLASS  N£L>  28 

SVB J LCX  Search  Formulation  Features 

TOPIC  Phrase  and  Term  Searching 

TIME  1 hour 


MAJOR  QBJECT1VE( S ) : To  introduce  students  to  additional  search 

techniques • 


■SPECIFIC  OBJECTIVES: 

1.  To  implement  available  comnands  in  conducting  a search 

2.  To  understand  the  relationship  between  the  comnand  and  the 
entry 

3.  To  understand  the  use  of  Boolean  expressions 

4.  To  understand  the  concepts  of  phrase  searches  in  natural  and 
inverted  order 

RESOURCE  MATERIALS  NEEDED: 

1 . Visuals. 

2 . Handout  s • 

3.  Access  to  NASA  RECON  terminal  s 

4.  Usage  Assignment  III 
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RECavMENDED  READINGS  : 

Introduction  to  Modern  Information  Retrieval  by 
NASA  RECON  User’s  Manual 


OUTSTANDING  ASSIG 


rS : Usage  Assignment  III 


ACTIVITIES: 


"^STUPENT  ORIENTED— 


1 . Note-taking 

2.  Receive  Usage  Assignment  III 
sp  2 

"INSTRUCTOR  ORIENTED— 

1.  Foil  presentation 

2.  Explanation  of  handouts 

3.  Demonstration  of  phrase  and  term  searches 

4.  Distribute  Usage  assignment  IIl(due  at  class 


STMvjARY  QE  LESSON: 

Lesson  teaches  basic  concepts  of  term  and 
Proximity  and  range  searches  are  introduced. 


G . Sa  1 1 on 


32) 


phrase  searches. 
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FOCAL  POINTS  (test  areas): 

1.  Understanding  of  phrase  search  concepts 
INSTRUCTOR  > S NOTES: 
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LESSON  PLANS 


CLASS  NO.  29 

SUBJECT  Search  Fo rmu lation  Features 
TOPIC  Root  and  Sub-string  Searches 

TIME  1 hour 

MAJOR  OBJECTIVE( S ) :To  enable  students  to  conduct  online  searches 
^SPECIFIC  OBJECTIVES: 

1.  To  implement  available  conmands  in  conducting  a search 
2 • To  under  s t and  the  concepts  of  root  and  sub-string  searches 

3.  To  understand  the  relationship  between  the  comnand  and  the 
returned  inf ormat ion 

4 . To  under  s t and  the  concept  of  comb  ini ng  comnand s for  search 
expr e s s ^ ons 

RESOURCE  MATERIALS  NEEDED; 

1 . Visuals, 

2.  Handouts 

3.  Access  to  NASA  RECON  terminals 

4.  NASA  RECON  User^s  Manual 
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££CQ^^ffi;^T)^:D  EEADJNGS  : 

Introduction  to  Modern  Information  Retrieval  by  G-  Salton 
NASA  RECON  User’s  Manual 

OUTSTANDING  ASSIGbMENTS:  Usage  Assignment  III 


ACTIVITIES: 


~ -STUDENT  ORIENTED— 

1 . Note-taking 

2.  Discussion  of  concepts 

3.  Hands-on  experience  with  terminals 


— INSTRUCTOR  ORIENTED— 

1.  Foil  presentation 

2.  Explanation  of  handouts 

3.  Demonstration  of  root  and  sub— string  searches 

4.  Monitoring  of  terminal  activities 

OE  LESSON: 


Lesson  teaches  the  important 
sub-string  conmands,  how  they  are 
will  produce. 


search 

concept  s 

of  root 

used. 

and  what 

resul  t s 

and 

they 
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£QCAL  POINTS  (test  areas): 

1.  How  to  conduct  root  searches 

2.  How  to  conduct  substring  searches 

3.  Relation  between  conmand  and  retrieved  information 
INSTRUCTOR  > S NOTES: 
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LESSON  PLANS 


CLASS  30 

■SUB JECX  Search  Formulation  Features 

TOPIC  Dictionary  Searchesand  Thesaurus  Searches 

TIME  1 hour 

MAJOR  OB.TECTIVE(S)  :Tn  enable  the  students  discover  word  meanings 

by  conducting  online  searches. 

^S-gJECIFlC  OBJECTIVES: 

1.  To  implement  available  conmands  in  conducting  a search 

2.  To  understand  the  relationship  between  comnands  and  the 
r e t r i e ved  entry 

3.  To  understand  the  concept  of  dictionary  searches 

4.  To  combine  conmands  for  search  expression 

BlESOURCE  materials  NEEDED: 

1 . Visuals. 

2.  Handouts 

3.  Access  to  NASA  RECON  terminals 

4 . NASA  User  * s Manua 1 (or  excerpts) 
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RECXlvMENDED  READINGS: 

Introduction  to  Modern  Information  Retrieval  by  G.  Salton 
NASA  RECON  User’s  Manual 


■OUTSTANDING  ASSIGNMENTS  : Us ag e Assignment  III 

ACTIVITIES; 

"STUDENT  ORIENTED— 

1 . Note-taking 
2.  Discussion  of  concepts 

-■INSTRUCTOR  ORIENTED— 

1.  Foil  presentation 

2.  Demonstration  of  dictionary  searches 

3.  Explanation  of  handouts 

-SIM4ARY  OH  LESSON: 

Lesson  teaches  the  impo r tant  concepts  of  dictionary  searches 
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FOCAL  POINTS  (test  areas): 

1.  How  to  conduct  dictionary  searches 

2.  Relationship  between  command  and  retrieved  information 

3.  Use  of  the  thesaurus 

INSTRUCTOR  > S NOTES: 
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LESSON  PI^NS 


NO.  31 


SUBJECT  Search 

Fo  rmu  1 a t i on 

Features 

TOPIC  Thesaurus  Searching,  Re 

Profiles 

1 a t i ona 1 

Operat ion, 

Search 

TIME 

1 hour 

MAJOR 

QBJECT1VE( S ) :To  enable 

the  s 

t udent  s 

to  conduct 

online 

s ear che  s 

^ECIFIC  OBJECTIVES: 

1.  To 

understand 

and  utilize 

the  thes 

aurus  fac 

ilities  in 

IS&R 

2.  To 

understand 

and  utilize 

Boo  lean 

operators 

in  queries 

3.  To 

understand 

the  concept 

of  searc 

h prof i 1 e 

s 

4.  To 

understand 

the  concept 

of  searc 

h strateg 

i e s 

• 

RESOURCE  MATERIALS  NEEDED: 

1 . Visuals. 

2.  NASA  User’s  Manual 

3.  Handouts 

4 . Ac  cess  to  NASA  RECON  t e rmi  n a 1 s 
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REOIvl^lENDED  READINGS  : 


Introduction  to  Modern  Information  Retrieval  by  G.  Salton 
NASA  User's  Manual 

OUTSTANDING  ASSIGNVIENTS : Usage  Assignment  III. 

ACTIVITIES: 

"-STUDENT  ORIENTED-- 
1 . Note-taking 

2.  Hands-on  experiences  with  terminals 

3.  Creative  query  construction 

4.  Boolean  exercises  and  problems 

5.  Discussion  of  concepts 

--JNSTRUCTQR  ORIENTED— 

1.  Foil  presentation 

2.  Explanation  of  handouts 

3-  Demonstration  of  thesaurus  searches.  Boolean  usage,  and  search 
profile 

4,  Demonstration  of  concept  of  Boolean  usage  in  conjunction  with 
exerc i ses 

5.  Monitoring  of  terminal  activities 
JSIM4ARY  QL  LESSON: 

Lesson  teaches  important  principles  of  searching  using  thesauri. 
Boolean  expressions,  and  search  profiles. 
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£QCAL  POINTS  (test  areas): 

1.  Use  of  Boolean  expressions 

2.  Use  of  the  thesaurus  in  search.e 

3.  Use  of  the  search  profile 

INSTRUCTOR  » S NOTES: 
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LESSON  PLANS 


CLASS  ml.  32 

SUBJECT  Search  Fo rmu lation  Features 

TOP IC  Request  Sets,  Search  Review 

TIME  1 hour 

M/VJQR  Q-B  J ECT I VE  ( S ) : T o enable  students  to  conduct  online  searches 
SPECIFIC  OBJECTIVES: 


1 . 

To 

introduce 

the 

concept 

of  search 

sets  and 

request  sets 

2 . 

To 

introduce 

the 

concept 

of  search 

r evi  ew 

3. 

To 

explain  the  value  of 

search  r 

e views 

current  status. 

sunmary , etc  . 


RESOURCE  MATERIALS  NEEDED: 

1 . Visuals. 

2.  Access  to  NASA  RECON  terminals 

3.  Handouts 

4.  NASA  User’s  Manual  (or  excerpts) 


RECCMVENDED  READINGS  : 

Introduction  to  Modern  Information  Retrieval  by  G.  Salton 
NASA  User’s  Manual 

OUTSTANDING  ASSIGbMENTS:  Usage  Assignment  III. 

1.  Usage  assignment  IV. 

ACTIVITIES: 

—STUDENT  ORIENTED— 

1 . Note-taking 

2.  Discussion  of  concepts 

3.  Hands-on  experiences  with  terminals 

4.  Turn  in  Usage  Assignment  III. 

— INSTRUCTOR  ORIENTED— 


1 . 

Foil 

presentat ion 

2 . 

Explanation  of  handouts 

3 . 

DemoE 

istration  of  searche 

s and  use  of  sets 

4. 

Moni  t 

oring  of  terminal  a 

ctivities 

5. 

Pick 

up  Usage  Assignment 

III 

SUVMARY 

QL  LESSON: 

Le 

s son 

shows  the  value  o 

f sets  and  search 

IS&R 

e s of 
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FOCAL  POINTS  (test  areas): 

1 . Usage  of  sets 

2.  Search  review  concepts 

3.  Available  session  information  and  its  usage 

4.  Saved  search  strategies 


mSTRUCTOR ^ S NOTES: 


lessqn  plans 


class  33 

SUBJECT  TEST 

IQP 1C  Bibliographic  Data  Base  Design  through  Search 

Formul ation  Features 

TIME  1 hour 


MAJOR  QBJECTJVECS)  :To  measure  the 

search  comnands 


s t udent  * s under  s t and ing 
and  their  usage  in  IS&R 


of 


SPECIFIC  OBJECTIVES; 


1.  To  measure  student’s  under 
Designs  and  File  structure 

2.  To  measure  understanding  o 

3.  To  measure  understanding 
searching 

4.  To  measure  understanding  o 

5.  To  measure  understanding  o 

6*  To  measure  understanding  o 
and  the  retrieved  informat 

MSOURCE  MATERIALS  NEEDED: 

1.  Prepared  Test2 


standing  of  Bibliographic  Data  Base 
s 

f the  concepts  of  Vocabulary  Control 
of  the  concepts  of  data  base 

f Search  Formulation  Features 

f comnands  and  their  usage 

f the  relationship  between  comnands 
ion 
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(No  tes  from  class  nos.  17  thru  32) 


HOvIEM^RK;  ASSlGMvlENTS:  None  . 

ACTIVITIES: 

— .S.TUPENT  ORIENTED— 

1 . Test! ng 

— INSTRUCTOR  ORIENTED— 

1.  Administration  of  Test2 

QE  LESSON: 

Not  App 1 i cabi e 
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focal  points  (test 

Not  App 1 i cab  1 e 
INSTRUCTOR  ’ S NOTES 


areas) 


LESSON  PLANS 


CLASS  NO.  34 

SUB J ECT  Output  Generation  Features 

TOPIC  Search  Review,  Online  vs  Offline,  Pre-def ined  & User 

Defined  Output  Formats 

TIME  1 hour 

MAJOR  OB JECTIVE( S ) :To  explain  the  concept  and  facilities  of 

output  in  IS&R  systems 

SPECIFIC  OBJECTIVES: 

1.  To  explain  the  difference  between  online  and  offline 
generat ion 

2.  To  show  pre-defined  output  formats 

3.  To  show  user— defined  output  formats 

4.  To  introduce  the  concept  of  printed  index  generation  (lead-in 
for  class  35) 

RESOURCE  MATERIALS  NEEDED; 

1 . Visuals. 

2.  Usage  Assignment  IV 
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RECC^^ffi:NDED  READINGS  : 


Any  IS&R  user’s  manual  on  Output  Generation  Features 
HOvlEVVORK  ASSIGNvlENTS:  None  . 

ACTIVITIES: 

— ^TUDJEIST  ORIENTED— 

1 . Note-taking 

2 . Di s cus  s i on 

3.  Receive  Usage  IV 

— INSTRUCTOR  ORIENTED— 

1.  Foil  presentation 

2.  Discussion  of  ex amp  I e s 

3.  Distribute  Usage  Assignment  IV  (due  at  class  38) 

SCMMARY  QE  LESSON: 

Lesson  presents  the  alternatives  available  for  output  formats  in 
I S&R  s y s t ems 


( 
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FOCAL  POINTS  (test  areas): 

1.  Value  of  user-defined  output 

2.  Value  of  pre-defined  output 

3.  Explanation  of  online  vs  offline  generation 

4.  Explanation  of  KWIC  and  KWOC  entries  (printed 
generat ion) 

INSTRUCTOR  » S NOTES: 


Index 
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LESSON  PLANS 


CLASS  ML.  35 

SUBJECT  Output  Generation 

TOP  I C Additional  Output  Features  and  Printed  Index  Generation 

TIME  1 hour 

MAJOR.  OB JECTIVE( S ) ;To  explain  the  output  facilities  available  on 

IS&R. 

SPECIFIC  OBJECTIVES: 

1.  To  explain  rapid  scan,  expanding,  highlighting,  sorting,  and 
ranking  procedures 

2,  To  explain  index  generation  (KWIC  and  IWDC) 

RESOURCE  MATERIALS  NEEDED: 

1 . Visuals. 

2.  NASA  RECON  User’s  Manual 

3.  Handouts  of  index  output 
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READINGS : 


NASA  User’s  Ma  n u a 1 

Information  Retrieval  System  (Chap.  14)  by  F.  W. 
Data  Base  Management  by  Averbach 

OUTSTANDING  ASS IGISMENTS  : Usage  Assignment  IV. 

ACTIVITIES: 

—.STUDENT  ORIENTED— 

1 . No t e- 1 aki ng 
2 . Di sens  s ion 

— INSTRUCTOR  ORIENTED— 

1.  Foil  presentation 

2.  Explanation  of  handouts 

3.  Explanation  of  instructional  features 

SUMMARY  QE  LESSON: 

Lesson  simmarizes  the  output  generation  features 


Lane  a s t e r 


of  IS&R. 
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ZQCAL  POINTS  (test  areas): 

1.  Index  generation  (KWIC  and  KWDC) 

2.  Additional  features  of  output  generation 

3.  Use  of  user  guides  in  diagnosing  problems 

INSTRUCTOR  > S NOTES: 


109 


lesson  plans 


CLA.SS  NQ^  36 

SUBJECT  Instructional  and  Diagnostic  Features 

TOPIC  User’s  guides,  Online  usage,  live  help,  error 

facilities 

TIME  1 hour 

MAJOR  QBJECTIVE(S) :To  demonstrate  the  facilities  available  for 

instructional  and  diagnostic  purposes  in  IS&R 
sy s t ems 


■SEECIFIC  OBJECTIVES: 

1.  To  understand  the  concept  of  online  documentation 

2.  To  understand  the  concept  of  online  training 

3.  To  understand  the  need  for  the  availability  of  live  help 

4.  To  understand  the  use  of  error  diagnostic  facilities 

5.  To  understand  the  use  of  sample  searches 

6.  To  understand  the  use  of  user’s  guides 

RESOURCE  M^ERIALS  NEEDED: 

« 

1 . Visuals. 

2.  Access  to  IS&R  system 


no 


RECCMVIENDED 
Any  IS&R  manual 

Information  Retrieval  System  (Chap.  14)  by  F.W.  Lancaster 
Data  Base  Management  by  Averbach 

Analysis  & Design  of  Information  Systems  by  J.A.  Senn 

The  Analysis,  Design,  and  Implementation  of  Information  Systems 

by  Henry  C.  Lucas 

OUTSTANDING  ASSIGhMENTS;  Usage  Assignment  IV 

ACTIVITIES: 

—STUDENT  ORIENTED— 

1 . Note-taking 

2.  Discussion  of  instructional  and  diagnostic  features 

3.  Hands-on  experiences  with  an  IS&R  system 

— INSTRUCTOR  ORIENTED— 

1.  Presentation  of  foils 

2.  Discussion  of  features 

3.  Monitoring  of  terminal  activities 


SLMVK^Y  0£  LESSON: 

Lesson  presents  the  facilities  available  in  IS&R  systems  for 
instruction  of  users  and  diagnosis  of  problems. 


Ill 


FOCAL  POINTS  (test  areas): 

1.  Types  of  instructional  facilities 

2.  Use  of  diagnostic  facilities 

3.  Use  of  user’s  guides  in  diagnosing  problems 
INSTRUCTOR’S  NOTES: 
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LESSON  PLANS 


CLASS  NO.  37 

SUBJECT  Additional  I S&R  Application  Areas 

TOPIC  Selective  Dissemination  of  Information/  Personal  Fi 

TIME  1 hour 

MAJOR  OBJECTIVE(S) :To  introduce  the  students  to  the  concept 

SDI  and  personal  data  bases. 

OBJECTIVES: 

1.  To  understand  the  concepts  of  SDI 

2.  To  understand  the  concept  of  personal  data  bases 

RESOURCE  MATERIALS  NEEDED: 

1 . Visuals. 


1 e s 


of 
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PECqVMENPEP  READINGS  : 


Information  Retrieval  On-Line  by  Lancaster  & Fayen  (Chaps.  14, 
16) 

Personalized  Data  Base  Systems  by  Benjamin  Gittman  and  Lorraine 
Borman 

OUTSTANDING  ASS IGbMENTS  : Usage  Assignment  IV. 

ACTIVITIES: 

—STUDENT  ORIENTED— 

1 . Note-taking 

2 . Di s cus s i on 

— INSTRUCTOR  ORIENTED— 

1.  Foil  presentation 

2.  Lecture 

■SUvMVRY  QZ  LESSON: 

Lesson  introduces  concept  of  SDI  and  current  awareness  systems 
and  personal  data  bases. 
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FOCAL  POINTS  (test  areas): 

1 . Concept  of  SDI 

2.  Concept  of  personal  data  bases 


JUNSTRUCTOR  ’ S NOTES: 


LESSON  PLANS 


CLASS  i^CL.  38 

SUBJECT  Additional  IS&R  Application  Areas 

TOPIC  Interfaces  with  Document  Delivery  Systems,  Combined 

Retrieval  Systems,  and  Personal  Computing  Systems 


TIME 


1 hour 


MAJOR  OBJECTIVES(S) : To  acquaint  the  student  with  specialized 

applications  of  IS&R  systems 


■SPECIFIC  OBJECTIVES: 

1.  To  understand  the  concept  of  combined  retrieval  systems 

2.  To  understand  the  value  of  document  retrieval  interfaces 


3.  To  appreciate  the  possibilities 
e n v i r o nme  n t s 


of  personal  computing 


RESOURCE  MATERIALS  NEEDED: 
1 . Visuals, 
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RECXJvMENDED  READINGS: 

Personalized  Data  Base  Systems  by  Benjamin  Gittman  and  Lorraine 
Borman 

Information  Retrieval  On-Line  by  Lancaster  & Fayen  (Chaps.  14,16) 
OUTSTANDING  ASS  IGbMENTS  : Usage  Assignment  IV. 


ACTIVITIES: 


--STUDENT  ORIENTED— 

1 . Note-taking 

2.  Discussi on 

3.  Turn  in  Usage  Assignment  IV 

—INSTRUCTOR  ORIENTED— 

1.  Foil  presentation  . 

2.  Lecture 

3.  Pick  up  Usage  Assignment  IV 
SUMMARY  OE  LESSON: 

Lesson  reiterates  the  value  of  document  delivery  systems  and 
interfaces  It  introduces  the  concept  of  combined  retrieval  and 
personal  computing  systems. 
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JQCAL  POINTS  (test  areas): 

1 . SDI  sy s t ems 

2.  Document  delivery  systems  (value  and  usage) 

3.  Personal  computing 

INSTRUCTOR'S  NOTES: 


118 


LESSON  PLANS 


CLASS  NO,  39 

SUBJECT  Phases  of  the  PME  Life  Cycle 
TOPIC  Phases/  Categorizations/  Parameters 

TIME  1 hour 


MAJOR  OBJECTIVE( S ) :To  understand  the  various  phases 

PME  evaluation  study  of  an  IS&R 


invo 1 ved 
sy  s t em 


in  a 


^ECIFIC  OBJECTIVES: 


1.  To  understand  various  phases  involved  in  a PME  evaluation 
s t udy 


2.  To  understand  the  idea  of  a hierarchical  evaluation  and  its 
value 


3. 


To  understand  and  recognize  the  various  parameters  which 
be  used  to  evaluate  IS&R 


can 


EESQURCE  Mft.TERIALS  NEEDEDi 


1 - Visuals, 
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EECQvMENDED  READINGS  ! 


Any  of  James  Martin’s  books 

Information  Retrieval  System  (Chap.  14)  by  F.  W.  Lancaster 
Data  Base  Management  by  Averbach 

Analysis  & Design  of  Information  Systems  by  J.  A.  Senn 

The  Analysis,  Design,  & Implementation  of  Information  Systems  by 
Henry  C.  Lucas 

OlTTSTANPINg  ASSIGhMENTS:  None  . 

ACTIVITIES: 

— .STVPENT  ORIENTED— 

1 . Note-taking 

2 . Di s cus  s i on 

— JI^STRUCTQR  ORIENTED— 

1.  Foil  presentation 

JSlftMARY  OE  LESSON: 

Lesson  looks  at  the  I^iE  life  cycle  and  how  it  is  evaluated. 
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FOCAL  POINTS  (test  areas): 

1.  Phases  of  the  PME  life  cycle 

2.  Identification  of  parameters  for  evaluation 
INSTRUCTOR'S  NOTES: 
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LESSON  PLANS 


CLASS  ML.  40 

SUBJECT  Phases  of  the  PME  Life  Cycle 

TOPIC  Evaluation  tools/  Experimentation/  Evaluation 

TIME  1 hour 


MAJOR  OBJECTIVE(S ) :To  understand  the  various  phases 

PME  evaluation  study  of  an  IS&R 


involved  in  a 
system 


SPECIFIC  OBJECTIVES; 

* 

1 . 

To 

under  stand 

the 

t e chn i que  s 

used  in  evaluating 

2. 

To 

understand 

the 

concept  of 

cost/benefit  analy 

RESOURCE  MATERIALS  NEEDED; 
1 . Visuals. 

2.  Handouts 

3.  Usage  Assignment  V 


IS&R  system 
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READINGS; 


Any  book  by  Jeimes  Martin 

Information  Retrieval  Systems  (Chap.  14)  by  F.  W.  Lancaster 
Data  Base  Management  by  Averbach 

Analysis  & Design  of  Information  Systems  by  J.  A.  Senn 

The  Analysis,  Design,  & Implementation  of  Information  Systems 
Henry  C.  Lucas 

DOTS  AND  I NG  ASSIGhMENTS: 

1.  Usage  Assignment  V 

ACTIVITIES: 

— STUDENT  ORIENTED — 

1 . Note-taking 

2.  Discussi on 

3.  Receive  Usage  Assignment  V 

—INSTRUCTOR  ORIENTED— 

1.  Foil  presentation 

2.  Explanation  of  handouts 

3.  Distribute  Usage  Assignment  V (due  at  class  44) 

SLMdARY  QE.  LESSON: 

Lesson  looks  at  the  various  techniques  used  in  evaluating 
systems  and  the  reasons  for  using  cost/benefit  analysis. 


by 


IS&R 
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£QCAL  POINTS  (test  areas): 

1.  Concept  of  cost/benefit  analysis 

2.  Techniques  in  evaluating  IS&R  systems 
5. 

INSTRUCTOR’S  NOTES: 
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LESSON  PLANS 


CLASS  NO.  41 

sup J ECT  Traditional  Obtrusive  User  N'lonitoring 
TOPIC  Concepts/  Experiments/  Subjective  assessments 

TIME  1 hour 

MA.JQR  QBJECTIVE(S)  :To  identify  and  define  methods  involving 

obtrusive  techniques  to  monitor  user 
interact i ons 


■SPECIFIC  OBJECTIVES: 


1 . 

To 

define  obti 

rusive  monitoring 

2. 

To 

under  s t and 

the  capabilities  and  limitations 

of  obtrusive 

moni t or ing 

3. 

To 

understand 

how  information  obtained  is  used 

in  design  and 

evaluat ion 

RESOURCE  MATERIALS  NEEDED: 


1 . Visuals. 


READINGS: 


Information  Retrieval  Systems  (Chaps.  9 - 12)  by  F.  W. 

OUTSTANDING  ASSIGbMENTS: 

1.  Usage  Assignment  V 

ACTIVITIES: 

—■STUDENT  ORIENTED  - 
1 . No  t e- 1 ak i ng 
3 . Di sens  s ion 

— INSTRUCTOR  ORIENTED— 

1.  Foil  presentation 

2.  Discussion  of  monitoring  advantages  and  limitations 
■SU>MM(Y  QL  LESSON: 

Lesson  looks  at  obtrusive  monitoring  and  its  limitations 
evaluat ion 


Lanca  s ter 


in  IS&R 
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LOCAL  POINTS  (test  areas): 


1.  Types  of  obtrusive  monitoring 

2.  Values  and  limitations  of  obtrusive 


mo  n i t o r i n g 


INSTRUCTOR ’ S NOTES : 


LESSON  PLANS 


CLASS  42 

SUBJECT  Traditional  Obtrusive  User  Monitoring 

■TOPIC  Recall  & Precision  Analysis/  Failure  Analysis/  Coverage 

TIME  1 hour 


MAJOR  QBJECTIVE(S) :To  identify  and  def  ine  methods  involving 

obtrusive  techniques  to  monitor  user 
interacti ons . 


SPECIFIC  OBJECTIVES: 

1 . 

To 

understand 

the 

value  of  mo n 

i tor ing 

2. 

To 

under  s t and 

the 

use  of  resul 

t s f r om  such  mo  nit 

3. 

To 

understand 

the 

concepts  of 

Recall  and  Precisi 

4. 

To 

understand 

Fai 

lure  .Analysis 

or  ing 
on 


RESOURCE  MATERIALS  NEEDED: 

1 . Visuals. 

2.  Access  to  IS&R  system 

3.  Homework  3 
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RECavfvlEyDED  READINGS  ; 

. I nf orma  t i on  Re t r i e va 1 Systems  (Chaps.  9 - 12)  by  F.  W. 

QUTSTANDING  ASSIGhMENTSr 
1 . Homework  3 
2.  Usage  Assignment  V 

ACTIVITIES: 


— STUDENT  ORIENTED— 

1 . No t e-t aking 

2.  Receive  Homework  3 

--INSTRUCTOR  ORIENTED— 

1.  Foil  presentation 
2 • Di sens  s ion 

3.  Distribute  Homework  3 

QL  LESSON: 

Lesson  looks  at  the  information  gained  from  obtrusive 
and  how  it  is  used 


Lanca  s t e r 


moni t or ing 
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FOCAL  POINTS  (test  areas): 

1.  Recall  and  Precision  Analysis 

2.  Failure  An  a 1 y s i s 

3.  Use  of  information  gained  through  monitoring 
INSTRUCTOR’S  NOTES: 
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LESSON  PLANS 


£-LASS  NQ^  43 

SUB J ECT.  Unobtrusive  User  Monitoring 

TQP I C Cone ep t s / Fa c i 1 i t i e s / Sy s t em  Usage  Profiles  and  analysis 

TIME  1 hour 

MAJOR  QB JECTIVEC S ) : To  define  unobtrusive  user  monitoring  and 

introduce  me thods  used  to  obtain  info rma t i o n • 


-SPECIFIC  OBJECTIVES: 


1 . 

To 

define  unob t rus i ve  moni t or ing 

2. 

To 

mon 

understand  the  capabilities 
i tor ing 

and 

1 imi  tations  of 

such 

• 

3. 

To 
de  s 

under  s t and  how  the  inf  orma  t i on 
ign 

is  us 

ed 

in  evaluat ion 

and 

4. 

To 

obtain  a basic  understanding 

of 

how 

such  sy  s t ems 

are 

imp  1 ement  ed 


RESOURCE  MATERIALS  NEEDED: 

1 . Vi  sua  I s . 

2.  Hands-on  access  to  an  IS&R  system 
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RECCMvIENDED 


Information  Retrieval  Systems  (Chaps.  9 - 12)  by  F.  W.  Lancaster 

QUTSAbjPING  ASSIGblVIFNTS: 

1 . Homework  3 

2.  Usage  Assignment  V 

ACTIVITIES: 

-“STUDENT  ORIENTED— 

1 . No  t e~  t ak i ng 

2.  Discussi on 

"INSTRUCTOR  ORIENTED— 

1.  Foil  presentation 

2*  Discussion  of  system 

« 

mMftLRY  QE  LESSON: 

Lesson  looks  at  unobtrusive  monitoring  and  its  limitations  and 
uses. 
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FOCAL  POINTS  (test  areas): 

1.  Definition  of  unobtrusive  monitoring 

2.  Value  of  unobtrusive  mo nitoring 

3.  Use  of  info rma tion  gathered 

INSTRUCTOR'S  NOTES: 
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lesson  PEANS 


class  44 

SUB  J ECT  Unobtrus 

TOPIC  Timing 

of  Results 


ive  User  Monitoring 

Analysis/  Error  Recovery  Analysis/ 


Ut 


1 i za  t i on 


TIME  1 hour 


MAJOR  QBJECTIVE(S) : To  define  unobtrusive  user  monitoring  and 

define  methods  used  to  obtain  information. 

SPECIFIC  QBLLECTIVES: 

1.  To  understand  what  type  of  information  can  be  obtained 

2.  To  understand  the  value  of  such  information  to  the  user  and 
des igner 

3.  To  understand  the  use  of  this  information  in  system  evaluation 


RESOURCE  MATERIALS  NEEDED: 
1 . Visuals. 
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JRECXI^^IENDED  READINGS  : 

Information  Retrieval  Systems  (Chaps.  9 - 12)  by  F.  W.  Lancaster 


OUTSTANDING  ASSIGhMENTS: 

1.  Homework  3. 

2.  Usage  Assignment  V 

ACrriVlTIES: 

— STUDENT  ORIENTED — 

1 . Note-taking 

2 . Di s cu s s i on 

3.  Turns  in  Usage  Assig nme n t V 

— INSTRUCTOR  ORIENTED— 

1.  Foil  presentation  . 

2.  Demonstration  of  system 

3.  Picking  Up  Usage  Asignment  V 

.SIMVIAJRY  QL  LESSON: 

Le sson  looks  at  the  value  of  unob t r u s i ve  mon i toring  and 
results  obtained. 


the 
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FOCAL  POINTS  (test  areas) 

1.  Timing  analysis 

2.  Error  Recovery  Analysi 

3.  Utilization  of  Results 


INSTRUCTOR’S  NOTES: 


LESSON  PLANS 


CLASS  ml.  45 

SUBJECT  Future  IS&R  Systems 
TOPIC  Languages  for  Retrieval 

TIME  1 hour 

M^QR  QB  JECriVE(  S ) :To  understand  the  various  possible  extensions 

to  computer  languages  and  the  uses  of  these 
future  languages. 

SPECIFIC  OBJECTIVES: 

1.  To  understand  the  concept  of  common  comnand  languages. 

2.  To  appreciate  the  possible  applications  of  special  character 

. 1 anguage  s . 

3.  To  understand  the  advantages  of  natural  languages. 


RESOURCE  MATERIALS  NEEDED: 
1 . Visuals. 
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EECCMvl-lNDED  RE.^DTNnS: 

Introduction  to  Modern  Information  Retrieval  by  G.  Salton  and  M. 
J . McGi  11, 

Design  of  Man-Computer  Dialogues  by  J.  Martin. 

QUTSTAI^ING  ASSIGbMENTSr  Homework  Assignment  3 
ACTIVITIES: 

— -STUPEMT  ORIENTED— 

1 . No  t e- 1 ak i ng 

2.  Discussi on 

— INSTRUCTOR  ORIENTED— 

1.  Foil  presentation 

SLNMMtY  OE  LESSON: 

The  lesson  looks  at  some  possible  future  developments  in 
languages  for  information  retrieval. 
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1.  Applications  of  special  character  languages. 

2.  Advantages  of  natural  languages. 

3.  Advantages  of  conmon  comnand  languages. 
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LESSON  PLANS 


CLASS  46 


TOPIC 

TIME 


Future  IS&R  Systems 

Alternate  User  Interfaces  and  PC  Environments 
1 hour 


MAJOR  QBJECTIVE(S) :To  involve  the 

possible  new 
future  app I i c a 


student  in  speculation  about 
man-machine  interfaces  and  the 
tions  of  personal  computers. 


SPECIFIC  OBJECTIVES: 


1 . 


To  show  the  student  the  possibility  of 
television  interfaces,  voice  and  text 
future  techniques. 


graphics  interfaces, 
recognition,  and  other 


To  understand  the  power 
envi r onment  s . 


and  flexibility  of 


personal 


comput ing 


EE.SQURCE  MATERIALS  NEEDED: 
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RECavMENDED  RE.'^DINGS  : 


Introduction  to  Modern  Information  Retrieval  by  G.  Salton  and  M 
J . McGi 11 

Human  Interaction  with  Computers  by  H.  T.  Smith  and  T.  R.  Green 

OUTSTANDING  ASS  IGMvlENTS : Homework  Assignment  3 

ACTIVITIES: 


—■STUDENT  ORIENTED— 


1 . Note-taking 

2 . Di s c u s s ion 

3.  Turn  in  homework  assignment  3. 

— INSTRUCTOR  ORIENTED— 

1.  Foil  presentation 

2.  Pick  up  Homework  Assignment  3 


S.MyMytY  QL  LESSON: 

The  lesson  presents  a survey  of  user  friendly  man-compute 
dialogues  of  the  future  and  some  uses  of  personal  computers. 


141 


riXTAJL  POINTS  (test  areas): 

1.  Experimental  input  and  output  devices. 

2.  Advantages  of  PC  environments. 

INSTRUCTOR'S  NOTES: 


LESSON  £LAN^ 


.CLASS  47 

SUBJECT  Future  I S&R  Sy s t ems 

TX)P 1C  Knowledge  Based  Systems  and  Distributed  Systems 

TIME  1 hour 


MAJOR  QB JECTIVE( S ) :To  understand  the  basic 

Based  Systems  and 
Sy s t ems  . 


concepts  of 
Distributed 


Knowl edge 
Comput ing 


SPECIFIC  OBJECTIVES: 

1 . The  learner  will  appreciate 
Knowledge  Based  Systems. 

2.  The  learner  will  understand 
constructing  a Knowledge  Based 

3.  The  learner  will  be  exposed  to 

4.  The  learner  will  understand 
distributed  c omput i ng . 


some  of  the  applications  of 

s ome  of  the  c omp  lexity  of 

System. 

the  idea  of  computing  networks, 
some  of  the  problems  of 


RESOURCE  MATERIALS  NEEDED: 
1 . Visuals. 
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PAGE  MISSING  FROM  AVAILABLE  VERSION 


FOCAL  POINTS  (test  areas): 

1.  Knowledge  representation  in  KBS. 

2.  Configurations  of  networks. 

-mSTRUCTQR^S  NOTES 
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LJISSQN  plans 


CLASS  48 

SUBJECT  FINAL  EXAMINATION 

TOPIC  Cumulative  topics  1 - 47 

TIME  1 hour 

MAJOR  OBJECTIVEC S ) :To  measure  student’s  mastery  of  the  concepts 

procedures,  and  operations  of  an  IS&R  system 

SPECIFIC  OBJECTIVES: 

1.  Not  Applicable 

AMQURCE  MATERIALS  NEEDED; 

1.  Prepared  Final  Examination 
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RECqvMENDED  READINGS  : 

Class  notes  NASA  RECON  User’s  Manual 

OUTSTANDING  ASSlGhMENTS:  None  . 

ACTIVITIES: 

—STUDENT  ORIENTED— 

1.  Test  taking 

— INSTRUCTOR  ORIENTED— 

1.  Administration  of  written  test 

iai^MARY  QL  LESSON: 

Not  Appl i cabl e 


147 


FOCAL  POINTS  (test  areas): 
1.  All  class  not  e s 


INSTRUCTOR » S NOTES: 
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ATTACHMENT  3.7 


COURSE  DEVELOPMENT  PHASE: 
FIRST  DRAFT  OF  PROPOSED 
COURSE  HOMEWORK  ASSIGNMENTS 

AND 


ANSWER  KEYS 


I NASA  I 


I N A S A I 


**********»««*««««**«»««***»*«*****»«»*»**«*»*«**»«»*»««» 


NASA  / RECON 

COURSE  DEVELOPMENT  SERIES 


FIRST  DRAFT: 

PROPOSED  COURSE  HCMEWORK  ASSIGNVIENTS 
AND  ANSWER  KEYS 

****«****«*«*«*««»«««s*««*»**»«»««»«**«««*«s«»»**ss»«*««s 


The  NASA/RECON  Course  Development  Series  contains  a collection  of 
draft  course  development  deliverables  representing  draft  results 
of  the  educational  course  development  activities  being  conducted 
pursuant  to  the  specifications  of  National  Aeronautics  and  Space 
Administration  Contract  Nmnber  NASW-3846. 

The  entries  within  this  series  are  in  "draft”  form;  they 
represent  work  in  progress  and  work  in  various  stages  of 
revision.  As  such,  they  should  not  be  construed  as  final 
products  nor  should  they  be  viewed  as  material  for  widespread 
distribution.  All  entries  within  this  series  will  be  subjected  to 
multiple  development  phase  revisions,  to  course  pilot 
administration,  and  to  final  course  pilot  evaluation  and  final 
revision  prior  to  being  distributed  as  final  course  deliverables. 


For  more  information,  contact: 
Wayne  D.  Dominick 
Editor 

NASA/RECON  Course  Development  Series 
Computer  Science  Department 
University  of  Southwestern  Louisiana 
P.  O.  Box  44330 
Lafayette,  Louisiana  70S04 
(318)  231-6308 


I COURSE  I 


I DEVELOHvlENT  I 


BJL  ± 


E 


miE_  JQ  INSTRUCTOR 


Note: 

The  questions  marked  with 
somewhat  difficult  questions, 
and  the  material  required 
visuals.  The  instructor  will 
are  able  to  handle  such  quest 


two  asterisks  (i.e.:  11.4**)  are 

They  involve  special  knowledge, 
is  not  completely  covered  in  the 
have  to  make  sure  that  his  students 
ions. 


The  questions  are  numbered  such  as: 


3.1 


where  the  ”3 ” 
number  (i.e.: 


in  the  number  of  the  lesson,  and 
the  first  question  in  lesson  3) 


ft  2 » 


a sequential 


1 


2 


im:qbma.tiqn  retrieval  using  computers 


3.1.  Discuss  the  advantages  and  disadvantages  of  manual 
searching. 

« » * 

See  Visuals  (Lesson  3) 


3.2.  Discuss  the  advantages  and  disadvantages  of  online 
searching. 

« « « 

See  Visuals  (Lesson  3) 

Some  di s advantage  s : 

The  limited  range  of  material  in  data  bases  (few  before  the 
early  70*s,  and  rare  in  some  fields). 

Complexity  of  searching  process  and  great  variety  of  systems 
ava i 1 ab 1 e . 

The  cost  is  sometimes  seen  as  a di sadvantage » also. 


3.3.  Compare  an  IS&R  search  with  a D£^^  search. 

« « « 

When  searching  in  a DBMS,  the  user  looks  for  an  exact  match 
(for  example:  SSN,  sex,  n^une ) 

In  IS&R  exact  matches  are  not  very  frequent,  and  often 
impossible  since  the  user  searches  for  items  (usually 
documents  or  abstracts)  which  pertain  to  the  general  subject 
defined  by  the  search  term. 


3.4.  Compare  the  data  in  an  IS&R  system,  and  in  a DEMS . 

« t » 

In  a DEMS , the  data  is  structured  and  very  often  numeric. 
In  an  IS&R,  the  data  is  most  of  the  time  in  natural  language 
(full  text  of  documents,  abstracts...) 
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USER  CATEGORIZATION 


4.1,  Discuss  the  reasons  for  user  categorization. 

« » * 

See  Visuals  (Lesson  4) 


4.2.  Who  has  the  primary  responsibility  of  protecting  the  data 
base  against  unauthorized  users? 


The  Data  Base  Administrator  (DBA)  has  the  primary 
responsibility  for  data  base  security. 


4.3.  If  we  define  the  "*owner”  of  some  data  as  the  person 
responsible  for  granting  and  deleting  access  rights,  as  well 
as  the  person  responsible  for  corrections  and  updates,  who 
in  the  Data  Base  is  the  **owner ” of  the  data? 


« » * i 

Generally,  in  a DEMS  each  End  User  is  the  "owner”  of  his  own 
data.  In  IS&R,  however,  the  user  can  only  retrieve 
informat  ion  and  only  if  access  has  been  granted  to  him  by 
the  Data  Base  Administrator. 

Note,  that  there  exist  many  exceptions,  where  end  users  are 
not  owners  of  the  data,  and  where  IS4S6R  system  end  users  own 
the  data.  But  the  general  rule  is  still  valid  in  mo  s t 
cases  . 


4.4.  An  end  user  is  trying  to  update  some  information,  but  the 
system  keeps  sending  nasty  messages.  What  do  you  think 
could  be  the  probl  em? 

1 ) The  end  user  may  not  be  us ing  the  proper  updat ing 
procedures . 

2)  He  may  not  be  authorized  to  update  that  information  (that 
is,  the  info rma t i on  mi ght  be  protected  f r om  update  by  the 
appl  ication  prog  ranine  r ) . 
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4.5.  Contrast  the  function  of  the  System  Administrator 
Data  Base  Administrator. 


and  the 


» « » 

The  system  administrator  has  authority  over  the  whole 
system,  while  the  data  base  administrator’s  responsibility 
is  limited  to  one  data  base. 

The  DBA  will  suggest  some  changes  to  be  made,  since  he  knows 
his  users’  needs,  but  the  System  Administrator  will  be  the 
one  to  decide  if  the  changes  are  actually  going  to  be  made. 


4.6.  De  scribe  the  role  of  the  Info  rma  tion  Specialist 


The  Information  Specialist  is  a professional  who  will  create 
and  enter  an  online  search  for  a person  in  need  of 
inf  ormat i on . 

Because  of  the  variety  of  systems  available,  and  the 
differences  between  the  data  bases,  an  occasional  user  will 
often  be  left  confused.  In  order  to  alleviate  frustration 
and  poor  productivity  resulting  from  users’  lack  of 
training,  the  Information  Specialist  has  become  a necessity. 
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DATA  £AS£  Mg2ELS 


5.1.  What  is  the  difference  between  data  stored  in  a data  file 
and  stored  in  a data  base? 


A file  is  a simple  collection  of  data.  The  relation  between 
the  items  are  fixed  when  the  data  is  created,  and  new 
relationships  can  not  be  created  without  changing  the  file 
s true  ture . 

A Data  Base  gives  multiple  views  of  the  stored  data.  Each 
user  has  a view  of  the  data  corresponding  to  his  own  needs. 
The  relationship  is  created  dynamically  as  required  by  the 
user. 


5.2.  Define  the  following  terms: 
a/  Data  Base 
b / It  em 
c/  Record 


A Data  Base  is  a collection  of  data,  and  the  relation  among 
the  data. 

An  Item  is  the  smallest  logical  unit  of  data  in  a data  base. 
A Record  is  a set  of  items  stored  as  a unit. 


5.3.  Define  a key. 

« « « 

A key  is  an  entity  used  to  identify  a record. 
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5.4.  What  is  a primary  key? 


In  some  cases,  many  keys  can  uniquely  identify  a record. 
One  key  has  to  be  selected  as  the  most  significant.  It  is 
called  the  "primary  key”. 


5.5.  What  are  multiple  keys? 


Multiple  keys  refer  to  the  situation  in  which  many  keys  can 
be  used  to  access  a single  record. 


5.6.  When  consulting  a linear  list,  how  many  i t ems  need  to  be 
consulted  on  the  average,  before  accessing  the  desired  one? 

**•  [(N+l)/2]  ( — > or  half  the  file) 


5.7.  Assume  a data  base  with  entities: 

DEPARTMENT,  DEAN,  FACULTY,  COURSE,  STUDENT,  OFFICE. 

Give  examples  of  one to one,  one to_jnany,  many to_jnany 

re  1 at i onships . 


one 1 0 one 


DEPT  < > 

FACULTY  < > 


DEAN 

OFFICE 


one_t  o_jnany 


DEPT  < > > COURSE 

DEPT  < > > STUDENT 

DEPT  < > > FACULTY 


ma  ny_t  o_pia  ny 


COURSE  < < > > STUDENT 

COURSE  < < > > FACULTY 


NOTE:  The  relationship  may  differ  depending  upon  the  meaning 

of  the  relation.  For  example,  DEPT  < > FACULTY  may 

be  a many_to_roany  relationship  if  some  faculties  are 
assigned  simultaneously  to  more  than  one  department. 
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5.8**  Network  or  hierarchical  models  define  the  relationship 
between  two  entites  explicitly  by  set  type  or  owner /member 
link,  but  the  relational  model  does  not  define  the 
relationship  between  two  entites. 

In  a relational  model,  how  can  a user  combine  two  relations? 
Give  an  example. 


Conxnon  data  item(s)  must  exist  between  two  relations,  in 
order  to  be  able  to  combine  them.  For  example: 

DEPARTMENT:  DEPT_NO,  DEPT_NAME,  DEPT _ADDR,  DEPTJHONE 

STUDENT  : STU_SSN,  STU _J^IAME , DEPT_NO,  STU_JBIRTH 

DEPT__NO( depar tmen t number)  is  the  comnon  data  item  which  is 
necessary  in  order  to  allow  combination  of  the  two 
r e 1 a t i ons . 


9**  In  a hierachical  mo  del, 
many_to_jnany  relationship? 
<<___>>  STUDENT  relation. 

how  can 
Give  an 

you  implement  a 

e X amp  1 e for  COURSE 

* « « 

De  sign 
i . e . R1 

two  owner-member  relations. 

: owner CX)URSE 

member — STUDENT 

R2 

: owner STUDENT 

member--  COURSE 
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5.10,  If  you  were  to  design  a data  base  to  keep  your  mailing 
list,  what  entities  would  you  use?  What  could  be  the  data 
items  included  in  these  entities?  Indicate  what  data  types 
you  wou  1 d use. 


« « « 


Name  : 

Last  name 
First  name 
Mi  d d 1 e n ame 


Addr e s s : 

Hou  s e 
Street 
Ci  ty 
State 
Zip  Code 


Ent i t i e s 
I 

\ Data 
/ It  ems 
I 


In  most  cases,  data  types  should  be  alphanumeric. 


5.11  Give  a brief  description  to  explain  the  relationships 
between  hospital  and  doctor,  room  and  patient,  patient  and 

patient  number . 

« « « 

m - m 

Hospital  < > doctor 

1 - m 

Room  < > patient 

1-1 

Patient  < > patient  nmnber 


5.12  What.  is  meant  by  data  redundancy?  How  can  it  be 
eliminated?  What  kind  of  problem  does  data  redundancy 
cause? 


S t or i ng  data  at  more  than  one  place  creates  data  redundancy . 
Storing  the  relationship  rather  than  storing  dup licate  data 
value  will  solve  the  problem.  Data  redundancy  could  create 
data  non- cons i s t ency . 


5.13  Assume  there  is  an  entirely  data  independent  model.  How 
will  a user  be  affected  if  the  way  the  data  stored  in  memory 
is  changed  ? 


« « « 

No  effect. 
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5.14  Given  the  diagram  below,  indicate  which  is  the  root  record, 
nodes,  and  leaves  ? 

COURSE 


I COURSE  I T I TLE  I DESCR I PT I ON 


I 

I 

I 


Pre-requisite  I 

I COURSE  I TITLE 


Offering  I 

I DATE  I LOCATION  I FORMAT  I 


I 


Teacher  I Student 


lEMP  1 NAME  I I EMP  INAME  I GRADE  I 


ttt 

Root  record 
Nodes 

Leave  s 


Course 

Course,  pre-requisite,  offering,  teacher, 
s t udent 

Pre-requisite,  teacher,  student 
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5.15  Given  the  following  diagreun,  what  is  the  tuple’s  primary 
key . 

Part  


1 

p 1 

p name 

1 color 

1 weight 

1 c i ty  1 

1 

pi  1 

nut 

1 red 

1 12 

1 London  1 

1 

pS  ) 

bolt 

1 green 

1 13 

1 London  1 

1 

p2  1 

nail 

1 blue 

1 10 

1 Paris  1 

1 

p3  1 

bolt 

1 green 

1 11 

1 New  York  1 

1 

p4  1 

nail 

1 yell o w 

1 13 

1 Jersey  1 

Tuples  primary  key  p 
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5.16  What  is  the  difference  between  Network  and  Hierarchical 
data  mo  dels? 

/ 

***  Networks  support  many  to  many  relationships,  while 
hierarchies  do  not. 


5.17.  How  many  steps  do  you  need  to  find  ”10”  in  sequential 
search  in  the  following  file?  How  many  for  a binary  search? 
File  : 2 5 7 10  20  30 

« » » 

4 and  3 . 
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JUQgICAL  DATA 


6.1.  What  is  a "data  dependent  application"?  Explain  with  an 
e X amp  1 e . 

1 1* 

An  application  is  called  ’data  dependent’  when  it  is 
dependent  on  the  data  structure  and  access  techniques. 
Therefore,  the  change  of  data  storage  structure  or  access 
technique  may  cause  modification  of  existing  application 
programs  . 

For  example: 

Suppose 


Record  A:  I STDNO(4)  I SEX( 1 ) I NAME(20)  I 


where  the  number  represents  the  length  of  each  field 

An  application  program  was  designed  to  use  the  5th  character 
to  count  the  number  of  males  and  females. 

Now  the  length  of  STDNO  is  changed  from  4to  5 due  to  an 
increase  in  student  enrollment. 

Then  the  application  program  should  be  modified  to  use  6th 
character  to  count  the  number  of  males  and  females. 

This  is  a data  dependent  application. 


6.2.  If  you  were  to  design  a STUDENT  data  base  reflecting 
activity  on  campus,  give  an  example  of  what  kind  of  data 
items  you  would  keep. 


Examp  1 e 
Student  ID 
Birth  Date 
Department 
Courses  taking 
GPA 


Student  Addr e s s 
Sex 

Courses  taken 
Grade 
Status 
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PHYSICAL  STORAGE  STRUCTURE 


6.3.  Why  is  the  null  value  important?  Give  an  example  to 
compute  the  average  salary  of  employees,  considering  that  at 
least  one  emp  1 oy e e works  wi  th  no  salary,  and  another  one  is 
not  working  for  this  pay  period. 


» « « 

The  null  value  is  a special  value  representing  ’unknown*  or 
’inapplicable’  value.  Some  system  may  assign  zero  to 
nume ric  field  as  default  value  of  nu 11  value. 

In  this  case,  the  application  progr  anxne  r should 
differentiate  between  the  number  zero  and  the  null  value 
zero,  both  being  used  in  the  numeric  field. 

For  ex  amp  1 e : 


Assume  a student  record  with  salary  given  to  working 
students . 


1 STD  NAME  1 

1 SALARY  1 

1 A 1 

1 200.00  1 

1 B I 

1 400.00  1 

1 C 

1 0.00  1 

• 

not  workingCdefaul t value) 

1 D 

1 0.00  1 

working  without  salary 

If  we  compute  the  average 
then  AVG  SALARY  = 
but  the  real  AVG  SALARY  = 


as  normal  method, 
(200+400)74  = 150 
(200+400)73  = 200. 


6.4.  Of  all  the  types  of  physical  structure  you  have  studied, 
whi ch  one s s e em  to  wa ste  the  least  storage  space?  Why? 


> « « 


Sequential  structure  is  most  efficient  as  far  as  storage 
space  is  concerned  since  the  other  types  of  structure  need 
extra  space  for  storing  indices  or  pointers  , in  addition  to 
dat a • 

However , when  data  is  redundant , then  the  cost  of  storing 
data  override  the  pointer  cost. 
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represented  by  tree 


6,5.  What  kind  of  data  model  can  be 
structure? 


Hierarchical  mo  del 


6.6.  Describe  the  advantages  and  disadvantages  of  serial  search 
and  binary  search. 

< * < 

Advantages : 

Serial  Search: 

* Simple  and  easy 

* Applicable  for  both  ordered  or  unordered  files 
Binary  Search: 

* Good  performance  for  large  files 

Di sadvantage  s : 

Serial  Search: 

* Poor  performance  for  large  files 
Binary  Search: 

* Not  possible  for  unordered  files 
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6.7**  There  are  at  most  50  students  without  name  duplication. 
Give  an  example  of  a . hash  function  (key  value  = student 
name)  and  consider  problem  occuring  fjrom  the  application  of 
the  hash  function. 


* « « 

Assign  number  to  each  letter  as  alphabetic  order. 
i.e.A^l,  B = C=*3f  ... 

Then 

address  = f(student  name) 

= (sum  of  each  letter  number  of  the  name)  mod  K 
where  K is  an  integer  greater  than  50. 

(Usually  choose  K as  a prime  number  to  reduce 
collision,  i.g.  53,  59  or  61.  ) 

For  ex  amp  1 e : 

If  the  student  name  = Martin  James,  then 
address  = (13+1+18+9+14+10+1+13+5+19)  mod  59 
= (103)  mod  59  = 44 
where  K = 59 . 


Prob 1 em: 

There  would  be  some  occasions  where  the  same  address 
could  be  generated  by  a number  of  different  names. 
This  kind  of  problem  is  called  ’’Collision”.  There  are 
several  kinds  of  strategies  to  solve  the  collision  in 
the  application  of  hash  f unc  t i on . 


16 


DATA  DEFINITION 


7.1,  What  are  the  disadvantages  of  data  redundancy?  Why  is  data 
redundancy  sometimes  allowed? 


» < « 

Advantages : 

* Easy  and  fast  search 

* Useful  error  detecting  (using  parity  check) 

* Easy  recovery  (using  replicated  data) 

Di s advantages : 

* Storage  wa s t e 

* May  cause  data  inconsistency 

* More  time  needed  for  updating 


7.2**  In  a university,  there  are  1000  students;  each  student 
take  s 3 courses. 

Show  the  redundancy  in  the  following  relation: 


I StudentID  I StudentName  1 Address  I Course  ! 


(5)  (lO)  (30)  (5)  * Storage  Required 

per  Student  / per  Cc 

Give  a solution  to  reduce  the  redundancy  and  compare  storage 
space  s . 


« « « 

We  can  reduce  the  redundancy  by  spliting  the  given  relation 
into  two  relation  such  that: 

R1  : StudentID,  StudentName,  Address 
R2  : StudentID,  Course 

1)  Given  relation 

space=  (5+5+10+30)  * 1000  ♦ 3 = 150000 

2)  Use  two  relations 

space*  (5+10+30)  * 1000  + (5+5)  * 1000  * 3 
= 80000 


7.3.  List  some  cases  which  can  lead  to  data  inconsistency. 

« « « 

1)  Data  redundancy 

2)  Incorrect  updating 

3)  Poor  Recovery 
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^ive  an 


e X amp  1 


* » * 


of  what  should  be  defined 


Schema  name 
Record(entity)  name 
Accessing  method 
Key( identifier) 

Set(relation)“n^®’ 

®wn  e r n ame 
Member  name 
Ordering  method 
Insertion  and 

Accessing  method^  method 


^ype , 1 eng  th 


in  a SCHEMA? 


7.5. 


Give  an  example 


from  7.4  of  a 


subs  chema  . 
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PATA  £AS£  INTERROGATION 


8.1,  What  are  the  main  steps  required  in  a search  cycle? 

9 t * 

( 1 ) Logg ing  in 

(2)  Selecting  files 

(3)  Entering  conmands 

(4)  Printing  results 

(5)  Logging  out 


8.2.  Give  examples  of  what  kind  of  information  is  provided  by 
the  system  when  a user  is  logging  out. 


« » » 

* Output  requested 

* Time  usage 

* Cost  of  the  session 

* Other  comnents 

8.3.  What  is  the  structure  of  a relational  expression? 

« « « 

<operand>  <relational  operator>  <operand> 


8.4.  Give  examples  of  some  conmon  standard  built-in  functions 
which  are  useful  for  arithmetic  computation. 

« « * 

SLM  ^MEAN 

MIN 

AVG  (Average)  STDDEV  (Standard  Deviation) 

NDD 
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8,5.  What  are  the  advantages  of  creating  a user  search  profile? 

It  facilitates  efficient  searching,  and  thus  brings  down  the 
cos t . 


8. 6,  Why  is  free  text  searching  more  expensive  than  index 
searching? 


* t* 

The  search  through  the  file  is  usually  a sequential  search, 
and  therefore  it  takes  a long  time. 


8.7.  When  is  the  free  text  search  more  desirable  than  the  index 
search? 


* * * 

When  the  term  searched  by  the  user  is  not  an  indexed  term? 


8.8.  Why  is  the  priority  of  logical  operations  important? 


« « « 

Each  logical  operator  is  assigned  a priority  and  the  search 
is  executed  according  to  this  priority. 

If  the  user  does  not  know  the  priorities,  the  execution  may 
produce  quite  a different  result  than  what  the  users  had 
ant i c i pa  t ed . 
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miA  BASE  UPDATE 


11.1.  Why  is  the  update  history  file  useful? 

* » * 

It  is  a necessary  tool  in  the  recovery  process 


11.2.  Wh  at  is  "deadlock”?  Give  an  ex  amp le  of  a deadlock 
situation  involving  locking  mechanisms. 

< « « 

One  of  the  advantages  of  a data  base  is  that  it  is  a 
multi— user  system  with  data  sharing.  But  there  are  some 
problems  when  two  (or  more)  users  attempt  to  update  the  same 
data  simultaneously.  "Lost  update”  and  "inconsistent 
retrievals"  are  typical  problems  of  simultaneous  data 
shar ing . 

One  of  the  comnon  solution  to  a data  sharing  problem  is  to 
prevent  another  user  from  accessing  the  data  that  is 
currently  in  use  (i.e.:  the  data  being  updated  is  the 

exclusive  domain  of  the  first  person  accessing  it). 

However,  the  exc lus ive.  locking  technique  ^ leads  to  another 
problem  called  "Dead  lock”. 

Dead  lock  is  a situation  which  results  when  two  (or  more) 
users  request  locks  on  the  data  which  has  been  locked  by  a 
previous  user. 

Therefore,  nobody  can  be  granted  access  to  the  data  forever 
in  a dead  lock  situation. 

For  examp  1 e : 

Userl  Lock  Datal 

User2  Lock  Data2 

Userl  request  Lock  Data2  waiting 

User2  request  Lock  Datal  waiting 

Since  Userl  and  User2  can  not  finish  updating,  they  do  not 
release  Datal  and  Data2  respectively,  which  leads  to  dead 
lock  situation. 
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11-3**  Time  stamping  mechanisms  are  a kind  of  deadlock-free 
mechanism.  Explain  the  technique. 


« « « 

The  basic  concept  of  time  stamp  mechanism  is  to  assign  a 
unique  timestamp  for  each  transaction  as  a priority. 

The  dead  lock  situation  occurs  only  when  there  is  a cycle 
among  waiting  transactions. 

Since  the  timestamps  are  issued  uniquely  in  increasing 
order,  no  two  same  cycles  are  possible  and  hence  no  dead 
lock  occurs . 
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miA  J3ASE  ^REDEFINITION 


.1.  Should  you  redefine  the  logical  structure  when  you 
redefine  the  physical  storage  structure  of  the  existing 
re lat ion?  Why? 

« « « 

No  . 

Since  the  logical  data  structure  is  independent  of  the 
physical  storage  structure,  we  need  not  redefine  the  logical 
structure.  For  example,  although  the  physical  storage 
structure  can  be  changed  from  sequential  file  to  linked  list 
file,  the  users  view  of  the  logical  data  structure  remains 
unchanged . 

However,  if  the  physical  storage  structure  redefinition 
involves  the  deletion  of  some  data  items  represented  in  the 
logical  data  structure,  then  the  user  should  be  aware  of 
such  change  s . 


AIMINISTRATTVK  FUNCTIONS 


12.2.  When  an  organization  wishes  to  change  from  one  system  to  a 
new  one,  who  is  responsible  for  the  transition? 


« « « 


The 


System  Administrator 
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DAIA  M$E  SECURITY 


13.1.  What  is  the  difference  between  authentication  and 
authorizati on? 


« « « 

Au then t i c a t i on : 

Verification  of  identity  to  enter  the  syst em 
Author i za t i on : 

Verification  of  access  right  to  access  an  object 


13.2.  Explain  the  "Access  Control  List"? 


Conmon  access  rights  are: 

(1) read(R)access 

(2)  execute(E)  access 

(3)  write  (W)  access 

The  access  control  list  is  a list  which  identifies  each  type 
of  access  proper  to  each  user  request. 

For  ex  amp  1 e : 


OBJECT  \ USER  1 

userl  1 

user2  1 

user3  1 ... 

userl .objectl 

1 REW 

1 R 

1 R i 

userl .object2 

1 REW 

1 RE 

1 1 

user2. objectl 

1 R 

1 REW 

1 REW  1 

user2 . ob j ect3 

1 REW 

1 REW 

us  er3  . ob j ec  t5 

1 

1 

1 REW  1 

where  the  blank  represents  no  access  right. 

Therefore,  when  a user  is  trying  to  access  an  object  that 
does  not  belong  to  him,  the  system  searches  the  access 
control  list  to  verify  the  authorization  before  allowing  him 
access  to  the  object. 


13.3.  A is  going  to  send  an  important  message  (M)  to  B in  who  is 
at  another  site,  through  unprotected  telephone  line. 

Suggest  a method  to  ensure  the  security  of  the  message. 


« « « 

Cryptography 

Step  (l)  A enciphers  M to  M*  by  using  a secret  key. 

Step  (2)  A sends  M*  to  B through  the  telephone  line. 

Step  (3)  B deciphers  M’  to  M by  using  the  predefined  secret  key. 
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13.4. 


What  kinds  of  methods  are  used  for  authorization  checking? 


« * « 


« 

* 

* 


Pa  s sword 
Cryptography 
Access  Control  List 
Procedure_based  Access  Control 
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PERFQRMANCg  MEASUREMENT  EVALUATION 


15.1  Why  is  the  efficiency  of  execution  being  studied  at 
different  levels? 


Execution  efficiency  depends  upon  a number  of  different 
system  characteristics.  In  order  to  determine  where  the 
roots  of  the  problem  are,  it  is  necesary  to  isolate  and 
identify  specific  problem  areas  at  different  levels. 


15.2.  List  at  least  two  tools  (or  techniques),  available  for 
Performance  Measurement  and  Evaluation.  Give  a brief 
description  of  each  tool  you  selected. 


Software  Monitor 
Hardware  Monitor 

Benchmark  and  Synthetic  Programs 
User  Questi onna ires 
Evaluation  Forms 


15.3  List  four  measurement  parameters  used  to  support  user 
interaction  analysis  performance  measurement  and  evaluation. 
Explain  each  of  them  briefly. 


1/  Response  time:  the  time  duration  between  the  initiation 
of  a request  and  the  fulfillment  of  that  request. 

2/  Output  Format  Complexity:  the  degree  of  difficulty 
associated  with  the  user  interpretation  of  output  from  the 
sy  s t em. 

3/  Completness  of  output:  the  ability  of  the  system  to 
retrieve  and  present  to  the  user  all  of  the  information  that 
the  user  requested. 

4/  Convenience  of  Access:  the  degree  to  which  the  system  is 
easy  to  learn  and  to  use. 
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15.4  List  four  measurement  parameters  used  by  the  system,  in 
order  to  check  efficiency  of  execution. 


* CPU  Time  (The  amount  of  central  processor  time  that  is 
required  to  satisfy  a request) 

* I/O  Time  (The  amount  of  I/O  time  required) 

* Cost  (The  total  cost  of  a request) 

* Storage  Requirements  (The  amount  of  storage  space  needed 
by  the  various  components  of  the  system,  and  by  the  data 
bases  supported  by  that  system) 
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fllBUQQRAPHIC  DATA  BASE  DESIGN 


17.1.  Assume  you  are  designing  a book  file  in  a library 
Design  the  book  record  format,  and  specify  indices, 
data  type  and  length  for  each  item  in  a record) 


* « » 


EXAMPLE 


Title 

Author 

Library  Congress  no 


i t em  n ame 

data  type 

1 eng  th 

Library  index  no. 

dec  ima  1 

10 

Title 

a Iphanume  r i c 

50 

Author 

a Iphabe  tic 

45 

Pub  1 i sh i ng  date 

date 

6 

Library  Congress 

no.  integer 

7 

Pub  1 i she  r 

a 1 phanumer  i c 

60 

Page  s 

integer 

4 

Language 

alphabet  ic 

3 

Keyword 

a 1 phanume  r i c 

60 

Abs  tract 

a Iphanume r i c 

var  i a 

index  term  Library  Index  no. 

(Choo  s e 
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BIBLIOGRAPHIC  FILE  STRUCTURE 


19.1.  Assume  a sequential  file  organization. 

If  the  record  length  is  fixed,  the  next  record  can  be  easily 
found  from  the  current  record, 
i.e.  the  address  of  next  record  = 

current  address  + record  length 

How  do  you  implement  the  variable  length  records  in  a 
sequential  file?  How  do  you  recognize  the  next  record 
po  s i t i on? 

* « « 

(1)  Using  a special  symbo 1 as  a separator  of  records. 

(2)  Design  the  record  to  contain  its  own  length  so  as  to  be 
able  to  compute  the  next  record  position. 

(3)  Maintain  a directory  which  contains  the  starting  address 
of  each  record. 

(4)  Maintain  fixed  length  records  and  link  to  the  overflow 
storage  area  for  the  oversized  records. 


19.2.  What  are  the  advantages  and  disadvantages  of  the  balanced 
tree? 

« * « 

Advantage : 

In  a balanced  tree,  the  average  length  of  path  from  the  root 
node  to  the  object  node  maybe  shorter  than  in  an  unbalanced 
tree.  i.e.  the  average  search  time  is  better. 

Di  s advant  ag  e : 

A balanced  tree  needs  to  be  reorganized  (balanced)  each  time 
nodes  are  inserted  or  deleted. 


19.3.  Give  two  examples  of  physical  representation  of  the 
following  tree  by  using  1 inks (pointers ) . 

A 


/ I 
/ I 

B C 

/ I I 

/ I I 

D E F 

I 
I 


G 
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« « « 


( 1 ) Using  mu Itiple  children  pointers 


Format;  I data  I ptrl  I ptr2  I ...  1 nil  I 


1 A 

1 ptr(B)  1 ptr(C) 

1 nil  1 

1 B 

1 ptr(D)  1 ptr(E) 

t nil  1 

1 C 

1 ptr(F)  1 nil  1 

1 D 

1 nil  1 1 E 

1 ptr(G)  1 nil  1 

1 F 

1 nil  1 1 G 

1 nil  1 

Using  first  son  & twin  pointer 

F o rma  t : 1 

data  1 ptr(s  on ) 1 

ptr(twin)  ! 

1 A 

1 ptr(B)  1 nil  1 

1 B 

1 ptr(D)  1 ptr(C)  1 

1 C 

1 ptr (F)  1 nil  1 

1 D 

1 nil  1 ptr(E)  1 

1 E 

1 ptr(G)  1 nil  1 

1 F 

1 nil  1 nil  1 

1 G 

1 nil  1 nil  1 
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(3)  Using  parent  pointer 


Format:  I data  I ptr(parent)  I 


I A I nil  i 


I B 

1 ptr(A)  1 1 

c 

1 ptr(A)  1 

1 D 

1 ptr(B)  1 1 

E 

1 ptr(B)  1 

1 F 

1 ptr(C)  1 1 

G 

1 ptr(E)  1 

is  the 

major  advantage 

of 

clustered 

A retrieval  of  specific  dociiment  will  cause  the  automatic 
retrieval  of  other  related  documents  since  all  related 
documents  are  grouped  together  (clustered). 


19.5.  Why  does  Indexed  Non-sequent ial  file  structure  need  full 
indexing? 

s « « 

Since  the  records  are  not  ordered  by  key,  the  unindexed 
records  can  not  be  found  if  partial  indexing  is  used. 


19.6.  Data  insertion  is  easier  in  Indexed  Non-sequent ial  file 
than  in  Indexed  Sequential  file,  since  data  reorganization 
is  not  needed.  But  Indexed  Non-s equent i a 1 file  is  not  as 
good  in  normal  applications.  Why? 


« « # 

Since  the  Indexed  Non-s equent i a 1 file  needs  full  indexing, 
it  takes  more  storage  space  and  in  a large  file,  it  may  need 
longer  searching  time. 
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19.7.  Clustered  file  structure  is  a unique  concept. 

problems  have  been  pointed  out  for  this  type  of  files, 
some  of  the  negative  aspects. 


* * * 

(1)  Complexity  of  Performance  Evaluation 

(2)  Complexity  of  Cluster  Generation 

(3)  Size  of  Storage  Space  Required 
(5)  Time  Needed  for  Retrieval 

(4)  Lack  of  Research 


Some 

List 


VOCABUIARY  CONTROL 


21.1.  Assume  three  searches  A,  B and  C on  a data  base. 

The  following  graph  represents  ’Recall’  & ’Precision’  of 
each  search . 

Give  comnents  for  each  search  based  on  the  characteristics 
of  terms  used  in  the  search. 


1.0 

Precision 


+ A 


+ B 


+ C 


Recall  1.0 


A 

B 

C 


used  too  general  terms 
good  search 

used  too  specific  terms 


21.2.  The  choice  of  index  terms  representing  each  document  is 
very  important  for  an  efficient  information  retrieval 
s y s t em . 

Discuss  the  problems  that  may  occur  when  the  index  terms  are 
assigned  manually. 


(1)  Need  Skilled  Indexers 

(2)  Evaluating  the  Document  Subjects  is  Time  Consiuning 

(3)  Time  Dependency  of  Indices 

(4)  Subjectivity  of  Indexers 


21.3.  What  index  terms  would  you  assign  to  any  scientific 
document  s? 


(1)  Title 

(2)  Key  words 

(3)  Words  in  chapter  heading 
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21. 4,  Suppose  A = number  of  relevant  documents  retrieved. 
Then  we  can  define  as 

Recall  = A/B  Precision  = A/C 

Define  B and  C in  above  formula. 


B = number  of  relevant  document  in  the  data  base 
C = number  of  documents  retrieved 


21.5.  Differentiate  between  Bound  and  Online  Thesaurus. 

< « * 

Bound  select  terms  to  help  design  search. 

Online  show  postable  terms. 


21.6.  How  do  you  implement  the  search  enlargement  and  search 
restriction  by  using  Thesaurus? 


« » « 

(1)  Search  enlarg erne n t 

use  Broader  terms 

use  Related  terms 

(2)  Search  restriction 

use  Narrower  terms 

use  Related  terms 


21.7.  In  general  it  is  desirable  to  exclude  very  rare  concept 
terms  from  the  Thesaurus*  since  those  terms  are  not  expected 
to  produce  many  matches. 

What  about  those  terms  with  a very  high  frequency  of 
occurrence? 


* zz 

Terms  occuring  with  a very  high  frequency  are  also  excluded 
from  the  Thesaurus*  since  they  produce  too  many  matches  for 
effective  retrievals. 


36 


BIBLIOGRAPHIC  DATA  BASE  SEARCHIM5 


25.1.  What  is  the  main  capability  of  ’HELP’  function? 


Introduce  the  semantic  and  syntactic  description  of  each 
commands  for  user. 


25. 2.  Categorize  the  following  data  sublanguage  conmands  into 
data  definition  language  and  data  manipulation  language. 


Create_dat abase 
Creat e_f  i le 
Op  e n_f  i 1 e 
Modi fy_record 
Orde  r_f  i 1 e 


« « # 

DDL Creat  e_d  a t a b a s e 

Create_f  i 1 e 


De  s t roy_da t aba  s e 
De  s t roy_f  i 1 e 
Find_record 
Insert_record 


De  s t roy_da t aba  s e 
De  s t roy_f  i 1 e 


EML Ope iL-f  i 1 e 

Modi fy_record 
Orde  r_f  i 1 e 


Find__record 
I n s e r t_r  e c o r d 


25.3.  What  is  the  primary  advantage  of  procedural  host  based 
data  sublanguage? 


« « « 

Since  the  data  sublanguage  is  mixed  with  or  called  from  the 
host  language,  user  can  use  data  base  information  in  the 
host  language  program  directly. 


25.4.  Describe  the  major  funtions  of  bibliographic  data  base 
search  languages. 


« « « 

(1)  Search  and  Selection 

(2)  Retrieval 

( 3 ) Report ing 
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25.5 


In  search  languages 
conditions  and  boolean 


the  queries 
cond i t i ons  • 


consist  of 


Give  an  example  of  the  combined  conditions. 

« « « 

author_name  = ’’DATE”  AND  publ  i shing_dat e >=  1980 
title  = "DATA  BASE"  OR  key_word  = "DATA  BASE" 


re  1 at i ona 1 
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filBlUQgRAfHIC  DATA  BASE  SEARCHING 


26. !•  What  are  the  comnon  language  operations  and  functions 
supported  by  search  languages? 


< « « 

Opera t ions : 

Boolean  Operation  (AND,  OR,  NOT) 

Relational  Operations  (EQ,NE ,GT ,LT ,GE , LE) 

Functions:  Builtin  Functions  (count,  exist) 

Report  Generation  Functions  (Default  report  format  and 
user  defined  report  fo  rma  t ) 


26.2.  What  are  the  conmon  language  comnands  available  in 
Procedural  host  languages?  Explain  briefly  each  function. 


« « » 

OPEN  specify  file  or  record  to  access 

CLOSE  specify  file  or  record  after  accessing  is  completed 
FIND  a record  in  a file 

GET  transfer  a record  to  the  program  work  area 
ORDER  sort  file  in  ascending  or  descending  order 


26.3.  Describe  the  characteristics  of  the  following  languages? 
a/  Procedural,  Host  Language  Based  languages 
b/  Self-Contained  Structural  Query  languages 
c/  Interactive,  Prompting  Oriented  languages 
d/  Batch,  Forms  Oriented  languages 
e/  Interactive,  Forms  Oriented  languages 

« « « 

a/  Sequential  Instructions 

b/  Simple,  Concise  and  English— Like  command  languages 
c/  User-Friendly,  prompt  oriented,  interactive,  online 
conxnand  language 

d/  Tabular  Syntax  filled  as  a form 

e/  Tabular  syntax  filled  on  the  screen  of  an  interactive 
terminal 
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26.4.  Which  type  of  languages  will 
capab i 1 i t i e s ? 


not  support  report  generation 


* « « 

Procedural,  host  language  based  languages. 


26.5.  Which  types  of  languages  are  dependent  on  data  structures, 
and  which  are  not? 


« « « 

Dependent:  Procedural  Host  Language  Based  languages 
Not  Dependent:  All  other  languages 


26.6.  In  interactive,  prompt  oriented  languages,  for  what 
information  is  the  user  being  prompted? 


The  user  is  prompted: 

for  granting  access,  for  next 

conments  or  for  help  request^. 


comnand,  for  system  usage 


26.7.  Why  do  users  need  search  languages? 


t « « 


To  retrieve  data  required  by  the  users  from  the  data  base. 
To  formulate  a request  for  data  in  a simple,  fairly  friendly 
way . 

To  have  non-pr oc edur a 1 i ty  in  language  style. 


41 


INSTRUCTIONAL  DIAGNOSTIC  EEATURES 


36.1.  What  is  the  content  of  a language  reference  manual? 


A language  reference  manual  contains  the  complete 
description  of  the  usage  and  syntax  of  the  language,  as  well 
as  error  diagnostics. 


36.2.  What  kind  of  informations  is  contained  in  handouts  for 
beg i nne  r s ? 


How  to  login  / How  to  logout 

Brief  explanations  of  terminal  keys 

Brief  explanations  of  help  facilities 

Brief  explanation  of  directory  structure  of  the  work  environment 
List  of  online  tutorials  available  on  system  for  beginners 
How  to  create  Text  and  simple  editing  features 


36.3.  List  three  types  of  software  tools. 

* « « 

Text  Editor 
Wo rd  Processor 
Statistical  Package 
Graphic  Tools 
Spread  Sheets 
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PHASES  QE_  XHH  EIFE  CYCLE 


40.1.  List  s ome  of  the  data  needed  as  me  a s u r erne  n t par  amt t e r s . 

« « « 

1/  Starting  Time  of  Session 
2/  Starting  CPU  Time 
3/  Ending  Time  of  Session 
4/  Ending  CPU  Time 
5/  Names  of  Files  Accessed 
6/  User  Comnents  On  Search 
7/  List  of  Errors  and  Types 
8/  Contexts  of  Errors 

40.2.  What  is  meant  by  "Performance  of  the  System"? 

« « * 

The  Performance  of  a system  is  the  indication  of  how  well  a 
system  performs.  It  indicates  the  real  value  of  the  system, 
• as  a tool  to  realize  some  tasks. 


40.3.  What  is  meant  by  "Evaluation  of  System"? 

« « « 

It  is  the  process  of  analyzing  the  functioning  and/or  usage 
of  a system,  so  that  decisions  can  be  made  concerning  the 
effectiveness  of  the  system  in  satisfying  its  design 
objectives . 


40.4.  What  is  the  purpose  of  Performance  Measurement  and 
Eva  1 ua  t i on? 


It  is  a tool  to  help  determine  the  actual  performance  of  the 
system.  It  also  helps  in  estimating  or  projecting  the 
performance  of  a new  system,  or  the  effects  of  a new 
workload  on  an  existing  system.  Finally,  it  helps  improve 
the  capabilities  of  a system,  by  allowing  constant  tuning. 


40.5.  Identify  the  generic  objectives  of  Performance  Measurement 
and  Evaluation. 


1/  Measure  and  evaluate  the  execution  efficiency  of  a system 
(the  emphasis  is  on  the  system) 

2/  Measure  and  evaluate  the  user’s  interactions  (the 
emphasis  is  on  the  user) 


40.6.  Why  is  Accuracy  being  stressed  as  a tool  in  Performance 
Measurement  and  Evaluation? 


The  data  collected  must  be  accurate  in  order  to  determine 
the  actual  performance  of  the  system.  If  the  measurement 
tool  is  inaccurate,  the  purpose  of  I^dE  can  not  be  achieved. 
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TBADITIQNAJL  QB.TJRUSIVE  USER  MMLTORIM} 


42.1.  Define  Recall. 

Recall  measures  the  ability  to  retrieve  from  the  system  as 
much  relevant  information  as  possible. 


42.2.  Define  Precision. 

« < « 

Precision  measures  the  ability  to  retrieve  from  the  system 
only  the  desired  information. 


42.3.  Let  the  number  of  je 1 evant  docmnents  retrieved  be  10,  and 
the  total  number  of  docmnents  in  the  data  base  be  20.  If 
the  total  number  of  docmnents  actually  retrieved  is  15, 
indicate  the  Recall  Ratio  and  the  Precision  Ratio. 


« * « 

Recall  : 10/20  (50%)  Precision:  10/15  (66.6%) 


42.4.  Why  are  offline  IS&R  Systems  oriented  towards  high  recall? 


In  offline  IS&R  Systems,  users  submit  their  search  requests 
to  the  retrieval  center.  After  some  time,  the  user  receives 
the  printed  output.  Such  a user  expects  the  final  output  to 
contain  all  the  relevant  information,  even  if  the  result  is 
embedded  among  less  relevant  documents:  he  will  read  the 
whole  print,  sorting  out  what  he  really  needs. 

On  the  contrary,  a searcher  online  will  have  a tendency  to 
try  to  select  only  what  he  really  needs,  in  order  to  reduce 
the  searching  cost. 

That  is  why  offline  search  is  oriented  towards  high  recall, 
and  online  towards  high  precision. 


42.5.  Indicates  at  least  three  human  factors  to  be  considered  in 
traditional  obtrusive  user  monitoring. 


1/  Human  Behavior  Characteristics  (human  behavior  may  change 
considerably  under  different  circumstances). 

2/  Variability  Control  (Experiments  to  measure  performances 
of  different  groups  under  different  conditions  require  that 
the  groups  be  selected  in  such  a way  that  their  overall 
characteristics  are  nearly  identical). 

3/  Legal  and  Moral  Factors  (The  information  collected  can 
not  be  legally  used  without  the  permission  of  the  subjects. 
The  experimenter  has  the  responsibility  to  protect  the 
users*  confidentiality). 

4/  Impact  on  User  Actions  (The  users  interactions  with  the 
system  may  be  inhibited  if  he  believes  his  actions  are 
ident i f iabl e ) . 


42.6.  What  factors  have  to  be  considered  in  designing  controlled 
usage  experiments? 


1/  Identify  and  narrow  the  scope  of  experimental  factors 
whose  impacts  will  be  studied. 

2/  Identify  contributing  factors  which  influence  variance  in 
expe  r iment  a 1 factors. 

3/  Determine  how  the  changes  in  experimental  factors  must  be 
presented  to  the  subjects  of  the  experiment. 


42.7.  Give  some  examples  of  subjective  assessment  of  traditional 
user  monitoring. 


« « « 

Questionnaires  and  ratings  collected  from  the  users  give  an 
idea  of  the  system  usability,  and  of  the  value  of  the 
interfaces.  In  particular,  it  gives  a chance  to  the  user  to 
conment  on: 

the  accuracy  of  the  information 
the  c omp  leteness  of  the  info  rma  t i o n 
the  ease  of  use  of  the  syst em 
the  help  in  correcting  errors 

Also,  interactive  conments  will  be  accepted  by  the  system. 
Users  have  the  opportunity  to  express  freely  their  problems, 
make  conments  on  unexpected  occurrences  and  any  aspects  of 
the  system.  Users  are  motivated  to  provide  conments. 
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mOBTOUSIVE  USER  MONITORING 


44.1.  What  are  the  Software  Engineering  characteristics  measured 
by  moni  tors? 


1/  Reliability:  how  often  system  failures  occur  (i.e.: 

abnormal  terminat ion) 

2/  Correctness:  does  the  system  actually  perform  all  the 

functions  expected  by  the  user? 

3/  Le arnab i 1 i ty : the  time  required  by  a user,  before 

obtaining  a certain  level  of  proficiency. 

4/  Usability:  How  easy  is  using  the  system,  once  a user  has 
been  taught . 

5/  Flexibility:  Can  the  system  be  easily  changed,  in  order 
to  meet  new  users*  requirements? 


44.2.  What  are  the  measurement  parameters 
error,  and  error  recovery  analysis? 


included  in  user 


nt* 


1/  Error  Rate:  Measure  changes  over  time  of  the  number  of 

errors  made  by  the  users. 

2/  Type  of  Errors 
3/  Use  of  Help  Conmands 


44.3.  What  are  the  benefits  of  advanced  unobtrusive  user 
moni t or ing? 


« « « 


It  helps  identify 
Enhancements  to  the  system 
Enhancements  to  monitors 

It  also  indicates  what  modifications  should  be  done  to  the 
experiment,  and  gives  feedback  to  the  system  designers. 
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ATTACHMENT  3.8 


COURSE  DEVELOPMENT  PHASE: 
FIRST  DRAFT  OF  PROPOSED  COURSE 


NASA  RECON  USAGE  ASSIGNMENTS 


I N A S A I 


1 N A S A I 


NASA  / RECON 

COURSE  DEVELOPMENT  SERIES 


FIRST  DRAFT: 

PROPOSED  COURSE  NASA/ RECON 
USAGE  ASSIG>MENTS 


»»»<»<****»»♦»»»***»»»«»*»♦*»»♦<*»»*»»»»»*»»»*»♦*»**»*»♦» 


The  NASA/RECON  Course  Development  Series  contains  a collection  of 
draft  course  development  deliverables  representing  draft  results 
of  the  educational  course  development  activities  being  conducted 
pursuant  to  the  specifications  of  National  Aeronautics  and  Space 
Administration  Contract  Number  NASW-3846. 

The  entries  within  this  series  are  in  "draft**  form;  they 
represent  work  in  progress  and  work  in  various  stages  of 
revision.  As  such,  they  should  not  be  construed  as  final 
products  nor  should  they  be  viewed  as  material  for  widespread 
distribution.  All  entries  within  this  series  will  be  subjected  to 
multiple  development  phase  revisions,  to  course  pilot 
administration,  and  to  final  course  pilot  evaluation  and  final 
revision  prior  to  being  distributed  as  final  course  deliverables* 


For  more  information,  contact: 
Wayne  D.  Dominick 
Ed i t or 

NASA/RECON  Course  Development  Series 
Computer  Science  Department 
University  of  Southwestern  Louisiana 
P.  O.  Box  44330 
Lafayette,  Louisiana  70504 
(318)  231-6308 


I COURSE  I 


I DEVELOPMENT  I 


USAGE  ASSIGhMENTS 
WITH 

ANSWER  KEYS 


RECQN  USAGE  assig: 


H i 


(Instructor’s  No  t e ) 


The  purpose  of  this  assignment  is  to  introduce  the  students 
to  the  RECON  system.  Before  this  assignment  is  given,  the 
instructor  should  explain  local  policies  and  terminal  usage  to 
the  students • 

The  log-in  procedure  is  not  discussed  in  this  assignment 
because  this  procedure  will  vary  from  school  to  school. 

The  students  should  read  the  section  1 through  3 of  the 
NASA/RECON  system  user’s  manual  before  starting  this  assignment. 
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RECQN  USAgE  ASSIGhMENT  J.  (KEY) 


Ob j e c t i ve  s : 

(1)  RECON  System  Logging- IN  and  OUT 

(2)  Basic  Comnands 

BEGIN,  BEGIN  BYPASS,  SELECT,  CGMBIfOE, 

DISPLAY,  END  SEARCH,  END  SEARCH  BYPASS, 

HELP , PAGE 

(l)  LOG-IN  to  RECON  by  using  log-in  instructions. 


(2)  Once  accepted  by  the  RECON  system,  enter  the  following 
comnands  one  at  a time  when  the  system  responds  "ENTER:”. 

BEGIN 

(*  follow  the  system  questionairs  to  enter 
the  file  collection  D(documents)  *) 

I ( * i n t e rme diate  user  level  *) 

EXPAND  ANIMi\LS 
SELECT  E06 
EXPAND  NAVIGATION 
SELECT  E06 
EXPAND  E06 
COMBINE  1 AND  2 
DISPLAY  3/2/ item  number 

(•  item  number  is  an  integer  in  the  set  *) 

(*  hand  copy  the  title,  author  and  publishing  date, 
and  turn  it  in  •) 

HELP 

HELP  X210 

(•  or  other  number  you  are  interested  *) 

PAGE 

END  SEARCH 
BEGIN  BYPASS  F 

I (*  intermediate  user  level  •) 

SELECT  ST/RADIATION 

(*  if  the  user  know  the  correct  indexed  term, 
he  can  use  SELECT  without  EXPAND  conmand  *) 

DISPLAY  1/2 
END  SEARCH  BYPASS 

(3)  Log-out  from  REOON 

(•  NOTE:  make  sure  you  are  logged  out  from  REOON  system 
c omp letely  *) 
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lUECQN  USAQE  ASSIG 


i^csiacij 


jj. 


(Instructor’s  Note) 

The  purpose  of  this  assignment  is  to  allow  the  students  to 
develop  their  first  search  based  on  the  Subject  search.  The 
basic  search  conmands  were  introduced  in  the  first  assignment  but 
were  not  discussed  in  any  details. 

The  students  should  understand  the  capability  of  EXPAND 
coirmand  by  using  term  or  reference  number,  and  COMBINE  conmand 
with  varying  boolean  expressions.  SELECT  and  SET  STATUS  conmands 
should  also  be  diss cussed  in  the  class  before  giving  this 
assignment.  The  SET  STATUS  conmand  is  useful  to  know  the  status 
of  all  sets  which  have  been  created  so  far. 

It  might  be  desirable  to  give  some  subject  terms  which  are 
of  interest  to  the  students  instead  of  the  terms  suggested  in  the 
problems  . 

There  may  be  several  ways  to  solve  the  given  problems.  The 
solutions  given  are  only  examples  of  techniques.  Note  also  that 
the  set  numbers  in  the  solution  may  not  be  correct  because  they 
depend  on  the  current  set  status. 

Finally,  the  number  of  hits  suggested  may  differ  slightly 
f r om  your  actual  search,  since  files  are  continuously  being 
updated . 
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RECQN  U.SAgg  ASSIGNV1E3MT  1±  (KEY) 


Object ives : 

(1)  File  select! on 

(2)  Search  Conxnands  and  Techniques 

SELECT,  EXPAND,  CCMBINE,  SET  STATUS, 

Subject  searches Major  Term(Mj) 

Minor  Tenn(M^) 


(1)  Find  all  references  on  BLACK  HOLE  (ASTRONOVIY)  by 
Term  searching  on: 

File  D ( 2007)  Hits 

File  F ( 50)  Hits  File  N Total  ( 2057) 


Total  ( 2057)  Hits 
Are  your  two  totals  the  same? 


hb  D 
i 

X BLACK  HOLE  (ASTRONOMY) 

(*  ST (subject  term)  is  the  default  file  code 
i n Do c ume nts  file  *) 

s E06 

bb  f 
i 

X ST/ BLACK  HOLE  (ASTRONOMY) 

(*  LT  is  the  default  file  code  in  F file  •) 

s E06 

bb  n 
i 

X ST/BLACX  HOLE  (ASTRONCMY) 
s E06 


(2)  Find  out  the  Title  and  Report  Nmnher  whose  accession 
is  83N13147. 

Title  : 

Report  Nmnber:  NASA-TM- 8 5 1 4 1 


Suh  j e c t 


Hits 


nmnber 


5 


(•  if  you  know  the  accession  number  you  can  display  directly 

*) 

d 83N13147 


(3)  How  many  accessions  contain  OZONE  LIGHTNING  as  subject  term 
in  file  D?  (start  from  EXPAND  OZONE  LIGHTNI1SK3) 


bb  D 
i 

(*  ’OZONE  LIGHTNING’  is  not  an  indexed  term,  so  you 
have  to  divide  and  combine  them  •) 

X OZONE  LIGHTNING 

s EOS  (*  select  subject  term  OZONE  •) 

X LICaiTNING 
s E06 

c 1 * 2 (*  combine  the  sets  OZONE  AND  LIGHTNING  *) 


(4)  How  many  accessions  contain  both  (in  file  D) : 

(A)  Major  Term:  TELECOvMUNICATION 

(B)  Minor  Term:  MICROWAVE  CIRCUITS 


s MJ/TELECChMUNI CATION 
s ht4/MICROWAVE  CIRCUITS 
c 1 * 2 


(5)  Find  all  references  by  Subject  Term,  in  file  D on: 

Celestial  Sphere  and  Solar  System  but  not  (Mars  or  Moon). 

How  many  sets  are  created  to  get  this  solution?  (Display  set 
descript i ons ) 


s CELESTIAL  SPHERE 
s SOLAR  SYSTEM 
s MARS 
s MX)N 

c 1 • 2 -(3  + 4) 

ss  (•  display  set  status  •) 
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^CQN  USAGE  ASSIG^MENT  JJJL 


(Instructor’s  Note) 


The  purpose  of  this  assignment  is  to  expand  the  student’s 
ability  to  extract  information  from  the  system.  The  use  of  LIMIT 
and  FREQUENCJY  will  be  introduced  as  well  as  the  use  of  complex 
search  expression.  Search  by  different  fields.  Proximity  and 
Phrase  search,  and  Root  and  Range  search  will  also  be  introduced. 


The  students 
searchable  fields 
this  assignment.  The 
user’s  manua 1 . 


should  understand  the 
for  each  file  collection, 
searchable  fields  are 


concept  of  various 
prior  to  performing 
described  in  the 


The  utilization  of  search  expression  needs  the  user  to 
combine  a number  of  sets  utilizing  various  boolean  expressions. 
The  students  should  be  familiar  with  the  usage  of  the  (XMBINE 
comnand . 


The  utilizations  of  searches  for  Report  Number  and  Authors 
consist  of  simply  finding  out  the  accession  numbers  which  are 
references  to  particular  reports  or  authors  within  a given  file 
collect  ion . 


In  the  text 
utilizati on  o f 


search  practice,  the  assig  nme  n t 
Proximity  and  Phrase  searches. 


requires 


the 
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Root  and  Range  searches  introduce  the  concept  of  retrieving 
documents,  based  on  the  root  of  a word  or  a range  in  either  the 
subject,  the  text  or  the  title  fields. 
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RECQN  USAGE  ASSIG: 


g>aiagi 


Q 111  (KEY) 


Objective:  Advanced  Search  Techniques 

LIMIT,  LIMIT  ALL,  RELEASE,  FREQUENCY, 

SEARCH  EXPRESSION, 

Search  by  Author,  Report  Number,  Contract  Ninnber... 

Text  Search  Proximity  and  Phrase  search 

Root  and  Range  Search 


(1)  A.  Find  all  references  about  ACID  RAIN  in  the  file  D,  using 
the  Thesaurus  Term,  the  Title,  the  Abstract,  and  the 
Analytic  Note  (use  SEARCH  EXPRESSION). 

B.  Find  the  same  in  the  Book  file  using  the  Thesaurus  Term, 
the  Title,  and  LT  for  ACID  and  RAIN  (combined). 

C.  Find  the  same  in  file  N. 


bb  D 
i 

se  UTP/ ’ACID  RAIN’  + AX/ ’ACID  RAIN’  + AL/ ’ACID  RAIN’ 
(*  D file  156  Hits*) 


bb  F 
i 

se  TTL/  ’ACID  RAIN’ 
(•  should  use 
(*  F file  


+ (LT/’ACID’  » ’RAIN’) 
single  word  for  LT  search  •) 
66  Hits*) 


bb  N 
i 

se  UTP/ ’ACID  RAIN’  + AX/ ’ACID  RAIN’  + AL/ ’ACID  RAIN’ 
se  TTL/ ’ACID  RAIN’  + (LT/’ACID’  * ’RAIN’) 
c 4 + 8 (*  combine  the  results  *) 

(*  N file 222  Hits  *) 


(2)  Find  the  Accession  Number  for  NASA-TM- 8 5 1 4 1 (Report  Number). 


» « « 

d RN/NASA-T\^85141 

(*  ACC:  83N13147  *) 
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Gordon 


and  Elizabeth 


(3)  Locate  an  energy  document  by  Karen 
Bacce 1 1 i . 


s AU/GORDON,  K. 
s AU/BACCLLI,  E. 
c 1 * 2 

(*  ACC:  83N13623  ») 

d 3 


(4)  How  many  periodicals  have  titles  such  as  "Proceedings  $$$ 
Conference”? 

(*  where  *$$$’  represents  any  words  *) 

Which  Major  Subject  Term  in  the  resulting  set  is  the  most 
frequently  used. 


bb  M 
i 

s PTL/ "PROCEEDINGS  *9  CONFERENCE” 
(•  title  proximity  search  *) 
(*  3 Hits  •)  . 

f lAdJ 


(5)  In  the  Document  file,  how  many  references  are  found  from  the 
Title  root:  "MICROC”? 

How  many  references  have  titles  between  MI CROCCMPUTER  and 
MICROCOPY? 


bb  D 
i 

s UTP/MICROC: 

s UTP /MI  CROCCMPUTER  :MICROCOPY 


(6)  From  the  result  of  range  search  of  (5) , how  many  of  them  are 
published  in  1975-1980? 


1 2/75-80 

(•  where  2 is  the  set  number  of  range  search  *) 
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(7) 

« « 


(8) 

« » 


Find  the  accession  numb er  of  the  doc umen t containing 
definition  of  "Flying  Peanut”? 


s AX/’FLYING  PEANUT’  (*  abstract  search  ») 

d 3 

(•  ACX::  83A16400  •) 


Find  the  book  entitled  "I  want  to  change  but  I don’t 
how”? 


bb  F 
i 

s TTL/ ’ I want  to  change  but  I don*’’t  know  how’ 
d 1 

(»  ACC:  82V52280  •) 


the 


know 
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JRECQN  USAGE  ASSIG: 


(Instructor’s  Note) 


The  purpose  of  this  assignment  is  to  show  the  students  the 
use  of  the  K££)P  comnand  and  in  the  utilization  of  stored  query 
sequences  • Th e students,  on  c omp letion  of  this  assig nme n t , 

should  be  able  to  create,  save,  delete,  edit  and  execute  stored 
queries.  They  should  also  be  able  to  use  the  KEEP  set  for 
storage  of  selected  retrievals. 

The  students  should  be  aware  that  BEGIN  and  BEGIN  BYPASS 
conmands  are  not  allowed  in  stored  query  sequences  and  that  there 
is  a limit  of  50  conmands  per  stored  query  sequence.  The  actual 
sequences  to  be  executed  should  be  very  carefully  designed  in 
order  to  eliminate  the  possibility  of  having  sequences  using 
large  amounts  of  time. 

It  is  very  useful  to  understand  the  capabilities  of  the 
three  special  characters  in  Query  conmands. 

»» I »* no-execution  capability 

**/** no-store  capability 

set-modification  capability 

The  KEEP  comnand  is  used  to  store  the  selected  results  in  a 
special  set:  the  set  99.  This  special  set  99  is  not  displayed  in 
set  history. 
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It  is  highly  r econmanded  to  have  the  students  try  all  Query 


conxnands  in  addition  to  the  given  problems. 
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J^ECQN  ySAQE  ASSIGNMENT  ,jy.  (KEY) 


Ob  j e c t i ve  : 


Stored  Search  Technique 
KEEP , RELEASE , 

QUERY  ( CREATE , EDIT, 

EXECUTE , ALTER . 

CANCEL,  LIST, 

QUIT,  PURGE, 


SAVE . / , ! , # . 

PAUSE,  CONTINUE. 
DELETE,  REPLACE, 
MEMBER  ) 


(l)  Create  a query  sequence  as  explained  below,  and  save  the 
query  in  the  library  under  the  name  QQ  followed  by  the 
fisrst  5 letters  of  your  name. 

(a)  Find  all  references  on  UFO’s  (in  subject  term). 

(B)  Find  all  references  on  SOLAR  SYSTEM  (in  subject  term). 

(C)  Combine  the  sets  (A)  AND  (B). 

(D)  Limit  the  accessions  to  material  published  between 
1979  and  1982. 

(E)  Display  on  the  screen  the  first  2 items  of  the  resulting  set 


» * » 


bb  D 
i 

q create 
s ST/UFO 

s ST/ SOLAR  SYSTEM 
c #1  * #2 

(*  set  modifications  are  required  •) 
1 #3/79-82 
d #4/2/l-2 
d 

q 


save  QQNAME 


(2) 


Display  the  list  of  the  saved  query  and  execute  it  in  file 
D. 


*** 


q 

q 


list  QQNAME 
execute  QQNAME 
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(3)  Modify  the  saved  query  as  follow  and  save  under  the  same 
name  . 

(a)  Change  the  LIMIT  of  publication  dates  to  1970-1983. 

(b)  Do  not  display  on  the  screen. 

(c)  Release  the  first  three  sets  created  without  adding  this 
to  the  query  sequence. 

(d)  Add  the  KEEP  comnand  to  save  all  items  of  the  resulting 
without  executing  in  edit  mode. 


« s « 

q edit  QQNAME 
q list 

q alter  4/1  #3/70-82 

(•  change  the  LIMIT  comnand  in  line  4 *) 
q delete  LAST  2 

(*  delete  last  two  comnands  in  the  query  *) 
/release  1-3 

(*  release  set  1 through  set  3 without  storing  *) 
flceep  #4 

(•  keep  the  limited  set  without  executing  now  •) 
q replace  QQNAME 


(4)  Display  the  query  list  and  execute  in  file  D. 

Display  all  accessions  kept  (use  format  1 ) . 

**  * 

q list  QQNAME 
q execute  QQNAME 

d 99/1  (*  keep  set  is  set  niunber  99  •) 

(5)  Execute  the  query  in  file  F and  display  all  accesions  kept. 


« « « 

bb  F 
i 

q execute  (XJNAME 
d 99/1 


(6)  Delete  your  saved  query  from  the  library. 


- 16  - 


ope  r a 1 
set 


QQNAME 


IfCQN  .U$AQE  ASSIGNV1ENT  Y 


(Instructor’s  Note) 


The  purpose  of  this  assignment  is  to  show  the  student’s  the 
facilities  to  output  the  informations  retrieved. 

The  comnands  SORT  and  SPECIFY  FORMAT  are  used  to  assist  in 
organizing  the  data  to  be  output  in  the  order  and  format  wanted. 
Th  e students  should  consult  the  user’s  ma  nual  section  about 
format,  before  starting  this  assignment. 

Both  the  PRINT  and  TYPE  comnands  are  used  to  print  out  the 
information.  But  the  instructor  should  be  careful  in  discussing 
the  PRINT  comnand,  since  the  PRINT  comnand  is  used  to  produce 
offline  printing  and  to  mail  output  to  the  users. 

The  CURRENT  and  CX^MAND  STATUS  comnands  are  also  presented. 


EfiCQN  USAGE  ASSIG: 


X (KEY) 


Objective:  Output  Request  and  Useful  Comnands 

SPECIFY  FORMAT,  SORT,  PRINT, 

TYPE,  CURRENT,  CCtvMAND  STATUS 


(1)  Find  all  references  about  MI CROCCMPUTER  in  the  book 
using  text  search. 


bb  F 
i 

s LT /MI  CROCCMPUTER 


(2)  Specify  the  format  as  Accession  Number,  Publishing 
Library  Congress  Number,  Author,  Title,  Abstract. 


sf  ACC,YER,CLN;AU;UTL;ABS 

(*  ACC,  date  and  CLN  are  formatted  in  same  line 


(3)  Sort  the  answer  of  (l)  by  Title. 


so  1/TTL 


(4)  Display  the  first  2 pages  and  TYPE  the  items  (5th 
10th)  in  specified  format. 


d 2/4/all 

p (•  display  the  next  page  of  the  set  •) 

t 2/4/5-10 

(5)  Find  all  references  about  PC  (personal  computer)  in 
term  and  combine(AND)  with  the  result  of  (l). 


s ST/PC 
c 1 » 3 


file. 


Da  t e , 


*) 


through 


subject 
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(6) 

« » 


(7) 

» « 


Sort  the  answer  of  (5)  by  the  Publishing  Date  in 
order,  and  display  the  first  2 pages. 


so  4/YER,  D 
d 5/4/all 

p (*  display  the  next  page  of  the  set  *) 

Display  current  file  collection. 


cu  FC 


descending 
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QUESTIONS  FOR  USAGE  ASSIGNVIENT  I 


1.1.  What  file  is  the  default  file  on  the  NASA/RECX)N  system, 
when  user  uses  BEGIN  BYPASS  without  specifying  any  file 
collect! on? 


Documents  file  (file  collection  D) 


1.2.  When  reading  online  a document  of  more  than  one  page,  how 
can  you  retrieve  the  previous  page? 


« « » 

Use  "PAGE  - ” comnand 
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QUESTIONS  FOR  USAGE  ASSIGNMENT  II 


2.1.  The  searchable  field  code s (mnemoni c ) may  vary  for  each  file 
in  RECX)N  system. 

Give  the  searchable  field  codes  in  Documents  file  and  NALNET 
Books  file  for  the  following  fields. 


(1) 

title 

(2) 

author 

(3) 

all  text  field 

* t * 

Do  c ume  n t s 

f i 1 e 

Books  file 

(1) 

title 

UTP 

TTL 

(2) 

author 

AU 

LA 

(3) 

all  text 

field 

TX 

LT 

2.2.  Explain  the  results  of  the  following  conmands  in  the 
NASA/ RECON  system: 


(1) 

COMBINE 

1- 

5/* 

(2) 

COMBINE 

1 

» 2 -3 

(3) 

COMBINE 

1 

* 2 -(3  + 

4) 

(1) 

The  new 

set 

result ing 

contains 

those  items 

whi  ch 

are 

conxnon  to  set  1 through  set  S. 

(2) 

The  new 

set 

contains 

those  items 

which  are 

conmon 

to 

both  set 

1 

and  set  2 

but  not  to 

set  3 . 

(3) 

Th  e n ew 

set 

contains 

those  items 

which  are 

conmon 

to 

both  set 

1 

and  set  2 

but  not  to 

set  3 nor  to 

set  4 . 

2.3.  When  a user  uses  EXPAND  conmand  to  expand  an  alphanumeric 
term,  the  RECON  system  displays  terms  from  the  appropriate 
inverted  file  that  are  alphabetically  adjacent  to  the  input 
term. 

How,  in  the  NASA/RECON  system,  can  you  expand  a term  in  the 
NASA  Thesaurus?  (Give  two  different  types  of  examples) 


« < « 

(1)  Using  Thesaurus  file  code, 
example:  EXPAND  TS/subject  term 

(2)  Using  E-reference  (or  R-reference)  number  from 
a previous  EXPAND  display. 

example:  EXPAND  E06 
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QUESTIONS  FOR  USAGE  ASSIGhMENT  III 


3.1.  What  is  the  function  of  the  LIMIT  RELEASE  conmand  in  RECX)N 
system? 


« « « 

The  LIMIT  ALL  conmand  remains  in  effect  until  an  END  SEARCH 
comnand  is  entered  or  until  a LIMIT  RELEASE  command  is 
entered. 

i.e.  The  LIMIT  RELEASE  conmand  releases  the  limitation 
previously  created  by  a LIMIT  ALL  conmand. 


3.2.  In  a phrase  text  search,  stop  words  are  being  ignored  by 
the  system. 

What  are  the  Stop  words  and  why  are  they  ignored  before  the 
conmand  execution? 


The  Stop  words  are  words  which  are  used  frequently  in  the 
text  and  do  not  affect  the  main  concept  of  the  text, 
i.e.  such  that  articles,  pronouns,  conjunctions,  ... 

The  Stop  words  are  defined  by  the  system  and  eliminated  in 
order  to  reduce  the  size  of  the  text  inverted  files  and 
speed  up  processing. 


3.3.  Explain  the  following  RECON  system  conmand. 
SELECT  -=ST/ROOTS 


« « « 

Select  both  the  items  that  are  indexed  to  ”ROOTS**  and  the 
term  that  precede  ”ROOTS”  in  the  Subject  Term  file. 


3.4.  Decimal  points,  conmas  or  some  other  special  characters  are 
treated  as  blank  characters  in  text  search  of  RECON  system. 

How  do  you  search  ”10.56**  by  using 

(1)  Proximity  search 

(2)  Phrase  search 

i n Ab  stract  field  of  Doc  xune  ntsfile? 


( 1 ) Proximity  search 
S AX/10  *+l  56 

( 2 ) Phr a s e search 
S AX/ *10  56* 
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3.5.  The  SEARCH  EXPRESSION  comnand  allows  user  to  enter  multiple 
SELECT  and  CCMBINE  conxnands  with  a single  entry  in  RECON 
sy  s t em. 


How  many  sets  are  created  by  the  following  comnand? 
List  each  set  with  its  description. 

SEARCH  EXPRESSION  (ATL/ACID  RAIN)  + AX/ *HIM\N  LIFE’ 


« * « 

set  no  . 


de script! on 


1 ATL/ACID 

2 ATL/RAIN 

3 1*2 

4 AX/HUViAN  LIFE 

5 3 + 4 
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QUESTIONS  FOR  USAGE  ASSIGNMENT  IV 


4.1.  The  KEEP  conmand  is  used  to  save  a single  item  or  a group 
of  items  of  particular  interest  in  a special  KEEP  set  in 
RECX)N  s y s t em . 

Which  set(set  number)  is  reserved  for  the  KEEP  conmand? 


s * « 

Set  99 


4.2.  List  the  four  query  modes  of  operations  in  the  NASA/RECX)N 
sy  s t em. 


( 1 ) CREATE  mo  d e 

(2)  EDIT  mode 

(3)  EXECUTE  mode 

(4)  PAUSE  mode 

Note:  Normal  mode  is  not  a query  mode. 


4.3.  Most  of  the  RECON  system  conmand s can  be  stored  in  a stored 
query  sequence. 

What  commands  are  not  permitted  in  a stored  query  sequence? 


* * » 

(1)  BEGIN 

(2)  BEGIN  BYPASS 


4.4.  How  can  you  delete  the  stored  query  sequence  in  RECON 
system  library? 


Use  ”QUERY  PURGE  s t or ed-que ry-name ” 


4.5.  Explain  the  ^query  conxnand  set  modification  capability”  in 
RECX)N  system. 

« « « 

If  a stored  query  sequence  is  to  be  executed  after  previous 
conmands  have  created  sets,  the  set  numbers  in  the  stored 
query  sequence  may  not  correspond  to  the  actual  set  numbers 
because  of  the  presence  of  the  preexisting  sets. 

RECON  system  use  a special  symbol#,  to  prefix  any  set  number 
in  any  position  in  a conmand  where  a set  modification  is 
required.  The  set  modification  capability  is  only  valid  in 
the  Query  CREATE/EDIT  mode. 
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4.6.  True  or  False  questions  (NASA/RECX3N  system). 

(1)  QUERY  ALTER  conmand  is  valid  when  the  user  is  not  only 
in  the  QUERY  CREATE/EDIT  modes  but  also  in  the  QUERY 
PAUSE  mode  . 

(2)  When  QUERY  DELETE  conmand  is  issued  without  operand,  it 
deletes  the  first  entered  comnand  in  the  query  sequence. 

(3)  When  QUERY  EDIT  conmand  is  issued  without  operand 
(stored  query  name),  the  most  recently  stored  query 
sequence  can  be  modified. 

(4)  A user  in  QUERY  CREATE/EDIT  mode  can  look  another  stored 
query  list  in  the  library. 

( 5 ) If  QUERY  SAVE  c onina  nd  is  issued  to  the  previously 
existing  stored  query  name,  it  overwrites  the  existing 
s tored  query . 

* 1 1 

( 1 ) true 

(2)  false 

(3)  false 

(4)  true 

(5)  false 
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QUESTIONS  FOR  USAGE  ASSIG>MENT  V 


5.1 


The  user’s  conmands  are  placed 
processing  when  the  users  transmit 
central  c omp uter  can  process  th em . 

Which  RECON  system  comxiand  can  be 
status  of  the  transmitted  comnand? 


in  a queue  to  wait 


comnand  s 

faster 

than 

the 

used  to 

find 

out 

the 

« t s 

CCM^IAND  STATUS 


5.2.  Sometimes  a user  may  forget  the  file  collection  on  which 
he/she  is  currently  searching. 


What  RECON  comnand  would  remind  him? 


* t * 

CURRENT 


5.3.  RECON  system  provides  four  format  options  in  the  DISPLAY 
comnand  . 

Describe  each  format  briefly. 


F o rma  t 1 
F o rma  t 2 

F o rma  t 4 
Format  6 


Only  the  accession  numbers  are  displayed. 

A full  citation  is  displayed. 

This  is  the  system  default  format  option. 

A citation  is  displayed  in  the  format 
specified  by  a previous  SPECIFY  FORMAT 
comnand  . 

A full  citation  excluding  abstract  is 
di splayed . 


5.4.  In  the  NASA/RECON  system,  the  SPECIFY  FORMAT  command  uses 
conmas  or  semicolons  to  separate  the  field  names  from  the 
operands . 

What  is  the  difference  between  comna  and  semicolon? 


A comna  in  a SPECIFY  FORMAT  indicates  that  the  field 
following  the  comna  will  be  output  on  the  same  line;  a 
semicolon  indicates  that  the  next  field  will  be  start  on  a 
new  line. 
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BASIC  RECON  TRAINING 


Find  all  references  on  ACID  RAIN  in  file  collection  D using 
the  Thesaurus  Term,  the  Title,  the  Abstract,  and  the 
Ana  lytic  Note . 

***  D = 416  hits 

B*  Find  same  in  file  collection  F(books)  using  the  Thesaurus 
Term,  the  Title,  the  Sub(LC  Indexing),  and  LT  for  ACID  and 
RAIN  (combined). 

•**  F = 57  hits 

C . Th e s ame  for  file  collection  P. 

***  P = 473  hits 

2.  Find  definition  of  "Flying  Peanut”. 

**•  83A16400 

3.  Find  Accession  Number  for  NASA-IM- 8 5 1 4 1 
*♦*  83N13147 

4.  Locate  an  energy  document  by  Karen  Gordon  and  Elizabeth 
Bacce 1 1 i . 

***  83N13623 

5.  What  is  the  most  popular  usage  of  the  acronym  EMP  in  the  NASA 
da  t a base? 

*•*  ???????? 

6.  Using  major  terms  only  on  file  D,  how  many  accessions  are 
found  under  Nitriding  of  Titanium  and  Ti tanium  A1  loys? 

***  64 

7.  Find  the  book  "The  World  of  Mathematics"  (in  4 volumes). 

**»  76V24889 
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ADVANCED  RECON  TRAINING 


1.  Find  all  references  on  the  TUNGUSK  METEORITE  by  searching  on: 

File  D (112)  hits  File  N total  (116)  hits 

File  F ( 4 ) hits 


Total  (116)  hits 
Arc  your  two  totals  the  same? 

2.  Find  all  references  on  UFO’s  in  file  F. 

(Hint:  Do  not  ignore  the  phrase  "Flying  Saucer”) 

***  Total  (411+) 

Sort  answer  by  Publication  Year  and  use  a specified  format  as 
foil  ow : 

ACC,  YER,  CLN,  AU,  UTL,  HLD 

Display  (first  2 pages)  and  print  (overnight)  sorted  set  in 
F o rma  t 4 . 


3.  Using  Phrase  Search  technique  and  Proximity  Search  technique 
on  file  G,  D and  F,  find  the  accession  and  citation  for: 
"Bibliography  on  the  Fatigue  of  Materials, 

Components  and  Structures”  Vol.2 

Answer  (ACC  No.  only)  (79A21725)  (79V26384) 

Is  there  a Volume  1 in  the  collection? 

If  yes,  ACC  No.  is  (73V12022)  (64N85407) 


4.  Which  NASA  Centers  have  Jane’s  All  the  World’s  Aircraft 
1978-79? 

**•  (GSFC,  JSC,  LaRC,  Hq . ) 


5.  Order  a listing  of  ACCIDENT  PREVENTION  MANUALS , 

Sort  by  YER,D,  Display  in  Format  4 ( ACC, YER, UTL). 

**•  (23  hits) 


6.  Locate  one  or  more  Periodicals  on  LINGUISTICS  OR  PHLOLOGY, 
Display  in  Format  2. 
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Using  KEEP  technique,  construct  a set  of  Accessions  os  the 
SUPERNOVA  of  1054  (AD  1054). 


7 . 


(a)  (lO)  hits  D file 

(B)  (1)  hits  G file 


8.  Find  an  SP , RP  or  CP. 

(A)  Animal  Navigation  (72N25062  NASA-SP-262) 

(B)  Lightning  Protection  of  Aircraft  (78N11024  NASA-RP- 1 008 ) 


Find  a book  entitled  "Compendium  of  Comnuni c at i on  and 
Broadcast  Satellites  1958  to  1980”. 

***  (82A18116  and  82V12640) 


10.  Find  a book  entitled  ”I  WANT  TO  CHAM3E  BUT  I DON’T  KNChV  HCW” 


***  (82V52280) 
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I.  INTRODUCTION 

The  purpose  of  this  document  is  to  establish  a set  of 
standards  for  authors  as  well  as  reviewers  of  the  USL/DBMS 
NASA/ RECON  Working  Paper  Series  to  maintain  a consistent  format 
among  such  working  papers. 

Each  manuscript  is  to  be  reviewed  by  two  reviewers  assigned 
by  the  editor,  using  the  reviewer  checklist  as  a guideline  for 
evaluating  various  issues  concerning  the  content  and  organization 
of  the  manuscript,  thereby,  insuring  its  completeness, 
consistency,  and  appropi atene s s . The  authors  are  then  provided 
feedback  with  as  much  conxnents  and  suggestions  as  possible  in  the 
conxnent  sheet.  This  process  of  review,  feedback  and  update  will 
be  iterated  until  the  final  version  of  the  manuscript  is  accepted 
for  the  Working  Paper  Series. 
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I I . PAPER  OUTLINE 


1 . INTRODUCTION 

The  purpose  of  the  paper  outline  is  twofold:  to  initiate  the 
research  process  so  that  authors  can  begin  identifying  relevant 
work  to  be  used  in  support  of  each  paper,  and  to  motivate  authors 
to  make  an  initial  attempt  at  formulating  the  content  of  each 
paper  and  the  approach  that  will  be  taken  to  the  presentation  of 
the  ma  t e r i a 1 . 


2.  OUTLINE  FORMAT 

Each  paper  outline  should  be  submitted  in  the  following 
f o rma  t : 

2.1  Cover  Sheet 

The  cover  sheet  should  identify  the  author  name,  and  the 
paper  name  . 

2.2  Table  of  Contents 

The  table  of  contents  should  be  an  outline  of  the  section 
and  subsection  titles  that  will  appear  in  the  paper.  An  example 
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is  given  bel ow: 

1 . INTRODUCTION 

2.  SECTION  ONE  TITLE 

2.1  Subsection  One 

2.2  Subsection  Two 

3.  SECTION  TWO  TITLE 

4.  SmiVIARY 

5 . REFERENCES 

6.  APPENDICES 

2.3  Detailed  Table  of  Contents 

For  each  section  and,  subsection  identified  in  Section  2.2, 
provide  further  details  about  the  content  of  each  section.  Your 
outline  should  provide  details  about  what  will  be  presented  and 
how  it  will  be  presented,  possibly  identifying  examples,  figures, 
and  tables  that  you  might  use.  In  general,  the  detailed  table  of 
contents  should  describe  the  approach  you  intend  to  take  in 
presentation  of  the  paper.  Appropriate  references  should  be 
included  within  the  outline  and  a list  of  all  references  should 
be  included  at  the  end  of  the  outline. 

2.4  List  of  References 

A tentative  list  of  references  should  be  included  within  the 
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paper  outline.  This  is  a tentative  list  since  you  will  probably 
add  more  references  or  decide  not  to  use  some  of  the  initial 
references.  Remember  that  the  objective  here  is  to  initiate  the 
research  process. 

All  references  should  be  listed  alphabetically  by  the  first 
author  s last  name*  The  reference  identification  is  enclosed  in 
square  brackets.  The  brackets  will  contain  the  first  author’s 
last  name  followed  by  the  year  of  the  publication  (last  two 
digits  of  the  year  only).  An  e x amp  le  of  a reference  is  given 
b e 1 ow: 

[Ullman,  79].  J.  D.  Ullman,  Priag  ip]j  g s jlL  Database  Systems  . 
Computer  Science  Press,  Washington,  D.  C. , 1979. 

No tice  that  the  first  line  of  a reference  should  appear  against 
the  left  margin  of  the  page.  Subsequent  lines  should  be  indented 
4 space  s . 

If  the  s ame  author  has  mo  re  than  one  publication  in  the  s ame 
year,  the  year  in  the  reference  identification  should  be  followed 
or  ”b”,  or  ”c”,  etc.  For  example: 

[U1  Iman , 79a ] . 

[U1  Iman,  79b]  . 

Wi  thin  the  report,  the  reference  identification  should  be  used  to 
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refer  to  the  book  or  article.  For  example: 

A s uimiary  of  the  relational  and  the  ne  two  rk  mode  Is  can 
be  f ound  in  [Ul Iman , 79 ] . 

Multiple  references  on  the  same  line  should  be  separated  by 
s emi colons  ( ex amp  1 e : [Ul Iman , 79a ; Ul Iman , 7 9b ])  . 

For  mo  re  than  one  author  of  a publication,  the  reference 
should  be  listed  as  foil  ows  : 

[ S t o n e b r ak e r , et.al,  76]-  M.  Stonebraker,  E.  Wong,  and  P.  Kreps, 
”The  Design  and  Implementation  of  Ingres,”  ACM  Transact  ions 
.on  ab  4 s g S.y  § t gmg  , vol.  1,  no.  3,  Sept.  1976. 

Also  notice  the  difference  be  twe  en  a book  reference  [Ul  Iman , 
79]  and  an  article  reference  [Stonebraker,  et.al,  76].  A book 
reference  has  the  book  name  underlined  and  is  followed  by  the 
publisher  name,  the  city  and  state  of  the  publisher,  and  the  year 
the  book  was  published.  For  article  references,  the  title  of  the 
article  is  enclosed  in  quotes  and  the  publication  in  wh i ch  the 
article  appeared  is  underlined.  The  publication  name  is  followed 
by  the  volume,  number,  and  month  and  year  of  the  publication. 
All  state  and  month  name  s should  be  abbreviated. 
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III.  ABSTRACT  GUIDELINES 

An  abstract  is  an  extr  erne  1 y c omp  ressed  overvi  e w used 
separately  from  the  paper  as  a locating  device  and  an  aid  to 
potential  readers  who  must  determine  if  they  need  to  read  the 
paper.  It  varies  in  length  from  one  hundred  words  to  a maximum 
o f two  hundred  and  fifty  words . Howe  ve  r,  since  abstracts  will  be 
published  or  circulated  separately  fr om  the  paper  or  report  as 
well  as  filed  in  indexes  and  information  retrieval  systems,  they 
must  be  very  compressed.  In  our  Working  Paper  Series,  abstracts 
should  appear  on  a separate  page  between  the  title  page  and  the 
table  of  contents  page  of  the  papers. 

When  writing  an  abstract,  the  author  should  keep  in  mind  the 
foil owi  ng : 

(1)  The  abstract  is  not  a substitute  for  the  introduction  of  the 

paper.  It  is  a supplement  which  in  no  way  should  affect  the 

basic  three-component  design  of  the  paper. 

(2)  The  abstract  is  not  a miniature  version  of  the  introduction 

of  the  paper  or  the  sunmary.  Unlike  the  sunmary,  it  does 

not  focus  upon  conclusions  and  recomnendat ions ; it  is 
intended  to  help  the  reader  to  decide  if  he  needs  to  read  or 
obtain  the  paper.  It  does  not  convey  sufficient  information 


1 STANDARDS  I 


9 


I WORKING  PAPER  SERIES  I 


I N A S A I 


ABSTRACT  GUIDELINES 


1 03/08/84  I 


to  be  ins trumental ly  useful  with  the  paper.  Instead,  it  is 
intended  to  help  readers  to  locate  and  screen  potentially 
useful  papers  or  reports. 


For  more  details  of  the  abstracting,  the  following 
guides  will  be  useful: 

DlJCCtions  for  Abstractors,  published  by  the  Chemical 
Abstracts  Service;  this  is  a standard  guide  for  abstracting 
scientific  research  articles  and  reports. 

Guidg  lings  Lax.  Cataloguing  and  Abstract  i ng  . published 
by  the  Defense  Dociunent  a t i on  Center;  this  is  the  guide  for 
abstracts  to  be  stored  in  the  federal  gover  nme  n t ’ s 
centralized  information  retrieval  systems,  such  as  RECON. 
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IV.  PAPER  FORMA.T 


1 . INTRODUCTION 

Since  our  goal  is  to  produce  a series  of  working  papers,  it 
is  important  to  establish  standards  in  order  to  maintain  a 
consistent  fo rma t amo ng  the  papers.  Th e f o rma t described  bel ow 
establishes  the  standards  that  should  be  followed  by  all  authors 
in  the  preparation  of  each  paper.  This  docxunent  should  also  be 
used  by  all  reviewers  in  order  to  insure  a consistent  format. 


2.  PAPER  ORGANIZATION 

Each  paper  will  be  organized  into  the  following  components; 

( 1 ) Head i ng . 

(2)  Secti ons . 

(a)  INTRODUCTION  Section. 

(b)  Content  Sections. 

(c)  SUVMUIY  Section. 

( 3 ) Ref  erenc e s . 

(4)  Appendices 
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2 . 1 He  ad i ng 

The  heading  should  identify  the  title  of  the  paper.  It 
should  be  centered  and  all  letters  should  be  capitalized. 

2.2  Sections 

There  are  three  types  of  sections  within  each  paper:  an 

introduction  section,  several  content  sections,  and  a sunmary 
section.  All  sections  are  preceeded  by  a section  number  and  a 
section  title.  The  section  numbers  are  of  the  formX.l,  X.2, 
X.3,  ...»  X.n,  where  **X**  is  the  section  number,  and  ”n”  is  the 

subsection  number.  All  letters  in  the  section  title  should  be 
capitalized.  There  should  be  two  spaces  between  the  section 
number  and  the  first  letter  of  the  section  title. 

Only  content  sections  can  have  subsections.  Each  subsection 
must  be  identified  by  a subsection  number  and  a subsection  title. 
All  subsection  numbers  are  of  the  form  X. 1.1,  X.1.2,  X.1.3,  etc. 
Subsections  can  have  sub-subsections  if  necessary,  following  the 
same  numbering  format.  Subsection  and  sub-subsection  titles 
should  have  only  the  first  letter  of  all  major  words  capitalized. 
There  should  be  two  spaces  between  the  subsection  number  and  the 
subsection  title. 

Both  section  and  subsection  numbers  should  be  placed  against 
the  left-most  margin  of  the  page.  Section  titles  should  be 
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preceeded  by  three  blank  lines.  The  content  of  a section  or 
subsection  should  begin  one  blank  line  below  the  section  title. 
Subsection  titles  should  be  preceeded  by  two  blank  lines.  Refer 
to  Figure  1 for  a sample  paper  format. 
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PERFORMANCE  MEASUREMENT  AND  EVALUATION 

1 . INTRODUCTION 

The  introduction  goes  here. 

2.  FIRST  CONTENT  SECTION 
A few  lines  here. 

2.1  Subsection  One 
Subsection  one  goes  here. 

2.2  Subsection  Two 
Subsection  two  goes  here. 

3.  SECOND  CONTENT  SECTION 
A f ew  lines  here. 

4.  SUhMARY 

Sunmary  goes  here. 

FIGURE  1 Sample  Chapter  Format 

2.2.1  INTRODUCTION  Section 

Each  paper  must  have  an  introduction  that  orients  the 
to  the  problems  and  issues  to  be  addressed  within  the  paper 


reader 
. The 
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introduction  should  be  brief  and  should  act  as  a ’’lead-in”  to  the 
remaining  sections  of  the  paper. 

The  word  ’’INTRODUCTION”  should  be  used  as  the  introduction 

title. 

2.2.2  Content  Sections 

Content  Sections  should  contain  the  actual  ”meat”  of  the 
paper.  Section  titles  should  be  short  and  should  be  named 
appropriately.  If  the  title  requires  mo  re  than  one  line,  the 
second  line  of  the  title  should  begin  in  the  same  column  as  the 
first  character  of  the  title  on  the  previous  line.  An  example  is 
presented  bel  o w : 

2.2  THIS  IS  A VERY  VERY  VERY  VERY  VERY  VERY 
LONG  TITLE 


Content  sections  can  have  subsections  and  subsections  can 
have  s ub- s ub s e c t i ons , etc.  Subsections  should  be  used  only  if 
the  section  can  be  broken  down  into  two  or  more  parts.  For 
example,  in  the  sample  below: 

2.1  THIS  IS  A SECTION 

2.1.1  This  is  a Sub-section 

This  is  the  content  of  the  subsection* 
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2.2  THIS  IS  THE  NEXT  SECTION 

2.1.1  is  an  unnecessary  subsection.  If  there  is  not  a 2.1.2, 
then  2.1.1  should  not  be  used. 

i 

Sect  ions  wh  ich  have  subsections  can  optionally  have 
introduction  paragraphs  between  the  section  title  and  the 
subsection  title.  For  ex  amp  le,  the  subsections  bel  o w begin 
inmediately  following  the  section  title: 

2 . 1 SECTION  TITLE 

2.1.1  Subsection  Title 
Subsection  content  goes  here. 

2.1.2  Subsection  Title 
Subsection  content  goes  here. 

In  contrast,  the  section  below  has  an  introduction  before 
the  beginning  of  the  first  subsection: 
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2.1  SECTION  TITLE 

This  section  addresses  methods  of  statistical  analysis  for 
evaluating  

2.1.1  Method  One 

Method  one  content  goes  here. 

2.1.2  Method  Two 

Method  two  content  goes  here. 

Either  approach  described  above  is  acceptable. 

2.2.3  SUMVIARY  Section 

Each  paper  must  have  a sumnary  that  recaps  the  important 
issues  addressed  within  the  paper.  The  word  "SOvMARY”  should  be 
used  as  the  sumnary  section  title. 

2.3  Tables  and  Figures 

All  tables  and  figures  should  be  placed  at  the  first 
available  location  closest  to  the  first  time  they  are  referenced. 
They  should  be  numbered  sequentially  with  tables  and  figures  each 
having  their  own  numbering  sequence.  All  tables  should  have  an 
identifying  title  line  centered  at  the  bottom  of  the  table.  The 
indentifying  line  should  consist  of  the  word  "TABLE”,  the  table 
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n umb er,  and  the  table  title.  An  e x amp le  is  presented  bel ow : 


ABODE 


1 I 

2 I 

3 I 

4 I 


TABLE  1 Table  Title 

Note  that  all  letters  in  the  word  TABLE  are  capitalized.  Only 
the  first  letters  of  major  words  in  the  table  title  are 
capitalized.  There  should  also  be  two  spaces  between  the  table 
number  and  the  table  title,  and  two  blank  lines  between  the  last 
line  of  the  table  and  the  table  title. 

When  referencing  a table,  only  the  first  letter  of  the  word 
"Table”  should  be  capitalized.  For  example: 

Notice  in  Table  1 that  .... 

All  formats  described  above  for  tables  also  apply  to 
f igures . 
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2.4  References 

Appropriate  references  should  be  made  throughout  the  paper 
to  all  work  used  to  support  the  content  of  the  paper.  A list  of 
all  references  should  appear  at  the  end  of  the  paper,  following 
all  tables  and  figures.  The  word  "REFEREINCES”  should  be  centered 
at  the  top  of  the  page.  The  first  reference  should  appear  two 
blank  lines  below  the  reference  title. 

All  references  should  be  listed  alphabetically  by  the  first 
author’s  last  name.  The  reference  identification  is  enclosed  in 
square  brackets.  The  brackets  contain  the  first  author’s  last 
name  followed  by  the  year  of  the  publication  (last  two  digits  of 
the  year  only).  An  example  of  a reference  is  given  below; 

[Ullman,  79].  J.  D.  Ullman,  Principles  slL  Database  Svs  t ems  . 

Computer  Science  Press,  Washington,  D.  C.,  1979. 

Notice  that  the  first  line  of  a reference  should  appear  against 
the  left  margin  of  the  page.  Subsequent  lines  should  be  indented 
4 spaces . 

If  the  same  author  has  more  than  one  publication  in  the  same 
year,  the  year  in  the  reference  identification  should  be  followed 
by  ”a”,  or  ”b”,  or  ”c”,  etc.  For  example: 

[Ul  Iman  , 79a  ] . 
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[Ul Iman , 79b ] . 

Within  the  chapter,  the  reference  identification  should  be  used 
to  refer  to  the  book  or  article.  For  ex  amp  1 e : 

A sunmary  of  the  relational  and  the  network  models  can 
be  found  in  [Ullman,  79]. 

Multiple  references  on  the  same  line  should  be  separated  by 
semicolons  (example:  [Ullman,  79a;  Ullman,  79b]). 

For  more  than  one  author  of  a publication,  the  reference 
should  be  listed  as  follows: 

[Stonebraker , et.al,  76].  M.  Stonebraker,  E.  Wong,  and  P.  Kreps , 
”The  Design  and  Implementation  of  Ingres,”  ACM  Transactions 
on  Database  Systems,  vol.  1,  no.  3,  Sept.  1976. 

Also  notice  the  difference  between  a book  reference  [Ullman, 
79]  and  an  article  reference  [Stonebraker,  et.al,  76].  A book 
reference  has  the  book  name  underlined  and  is  followed  by  the 
publisher  name,  the  city  and  state  of  the  publisher,  and  the  year 
the  book  was  published.  For  article  references,  the  title  of  the 
article  is  enclosed  in  quotes  and  the  publication  in  which  the 
article  appeared  is  underlined.  The  publication  name  is  followed 
by  the  volume,  number,  and  month  and  year  of  the  publication. 
All  state  and  month  names  should  be  abbreviated. 
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3.  INDENTATION,  SPACING,  AND  PAGE  NIMBERING 

All  paragraphs  should  be  indented  five  spaces.  All  lines 
within  a paragraph  should  be  double  spaced.  There  should  be  one 
blank  line  between  each  paragraph.  The  lines  within  a reference 
should  be  single  spaced.  There  should  be  one  blank  line  between 
each  reference. 

All  pages  should  have  a page  number  centered  at  the  bottom 
of  the  page  . 

4.  LISTINGS 

To  list  a sequence  of  items,  use  the  following  format: 

(1)  Two  blanks  lines  should  appear  before  the  listing. 

(2)  Two  blank  lines  should  appear  after  the  listing. 

(3)  Use  niunbers  to  identify  each  item  in  the  listing. 

(4)  Enclose  numbers  in  parentheses. 

(5)  The  first  character  of  each  item  listed  should  be 
capitalized. 

(6)  Indent  the  entire  listing  five  spaces. 

(7)  To  continue  an  item  on  a second  line,  the  second  line 
should  be  in  line  with  the  first  character  of  the 
firstline. 
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(8)  Each  item  should  end  with  a period. 

(9)  For  items  identified  by  a single  digit  number,  leave 
three  spaces  between  the  right  parenthesis  and  the 
first  word  of  the  item. 

(10)  For  items  identified  by  a two  digit  number,  leave  two 
spaces  between  the  right  parenthesis  and  the  first 
word  of  the  item. 

5 . PAPER  STYI.E 


Since  the  objectives  of  this  work  is  to  produce  tutorials  as 
well  as  research  reports,  a different  approach  should  be  taken 
to  writing  the  papers.  Writing  should  be  aimed  at  informing  and 
teaching  the  intended  audience  as  well  as  reporting  research 
findings.  Included  below  are  a few  guidelines  which  might  help 
in  achieving  these  type  of  writing  objectives. 

(l)  Writing  must  be  ACCURATE.  Check  for  deficiencies  in 
the  coverage  of  a topic.  Avoid  misleading  statements. 
Do  not  include  those  personal  opinion  without 
sufficient  support  from  the  results  of  simulation, 
formal  or  informal  proofs.  Include  sufficient 
examples,  figures,  and  tables  in  order  to  clarify  a 
subject . 
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(2)  Write  clearly,  concisely  and  in  an  organized  manner. 
Avoid  £imbiguity,  undue  formalism  and  obscure  notations 
and  symbols.  Define  any  symbols  and  all  uncommon 
terminology  before  using  in  a discussion.  Try  not  to 
make  the  subject  harder  than  need  be. 

(3)  Set  forth  your  assumptions  about  the  reader’s 

background.  Make  reasonable  assumptions  about  the 
reader.  Tell  the  reader  what  to  expect,  what  material 
is  included  and  what  subjects  are  to  be  excluded. 
Perhaps  the  a more  advanced  reader  may  be  advised  to 
omit  or  briefly  review  certain  introductory  sections. 
Cover  all  topics  as  promised  in  the  introduction. 
Recap  paper  highlights  and  discuss  conclusions  at  the 
end  of  the  paper. 

(4)  Make  the  subject  as  interesting  as  possible  while 
still  being  informative.  Try  to  stimulate  the  reader 
(if  possible)  rather  than  put  him  to  sleep. 

(5)  Accurately  reference  literature  cited.  Include 
references  to  articles  which  may  provide  helpful 
tutorials  or  background  material  on  a subject. 
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V.  UNDERLINING 

To  underline  words  within  a paragraph  or  to  underline  the  title 
of  a book  or  journal  within  a reference,  do  the  following; 

1.  Before  the  first  character  to  be  underlined,  type  ”\016”. 

2.  After  the  last  character  to  be  underlined,  type  ”\017”. 

3.  Use  automatic  underlining  runoff  instead  of  runoff.  For 
example,  instead  of  typing: 

rf  DBMS  .NASA/ RECON-X 

type 

aurf  DBMS  .NASA/ RECX)N-X 

Note  that  blank  characters  between  ”\016**  and  ”\017”  will  not  be 
under  1 ined . 
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VI  . AUTOVIATIC  NIMBERING  OF  TABLES  AND  FIGURES 

Since  all  papers  will  be  subject  to  change  during  the  review 
process,  it  is  important  to  avoid  ’’hardcoding”  things  such  as 
table  and  figure  n umb ers  into  the  paper  if  it  can  be  avoided.  As 
a result,  all  authors  should  follow  the  standards  described  below 
for  a u t oma tically  n umb ering  all  tables  and  figures. 

1.  At  the  beginning  of  each  paper,  initialize  a figure  counter 
and  a table  counter  as  follows: 

. s r f i g c t r 0 

. s r t a b_c  t r 0 

The  ’’.sr*’  comnand  is  a runoff  conmand  that  allows  you  to  set 
the  value  of  a variable. 

2.  Before  assigning  a number  to  a figure  or  a table,  increment 
the  appropriate  counter  as  follows: 

. sr  fig  _c  t r %f i g c t r%+ 1 
.ur  %fig_ctr% 

The  ”.ur”  conmand  allows  all  variables  surrounded  by  percent 
signs  to  be  evaluated.  The  ”.sr”  conmand  will  then  take  the 
evaluated  value,  add  1 to  the  value,  and  store  the  result  in 
f i g c t r . 
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3.  Create  a symbolic  name  to  represent  each  figure 

within  the  paper.  Use  the  names  fig 1,  fig 2, 

t a b_l  , t a b_2  , etc. 

4.  To  automatically  number  each  figure  (or  table), 
the  counter  (as  described  in  part  2 above),  and 
counter  value  to  the  symbolic  name  using  the  ”.sr 
as  foil ows  : 

. s r f i g_l  %{  i g_c  t r% 

The  symbolic  name  can  then  be  referenced. 


and  table 
etc.,  and 

i nc  r ement 
a s s i gn  the 
” comnand 
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VII.  PAPER  SUBMISSION  POLICIES 


1 . INTRODUCTION 

In  order  to  promote  an  efficient  reviewing  process  and  to 
ensure  uniformity  between  papers,  the  following  list  of  standards 
will  comprise  the  submission  policy  and  must  be  adhered  to. 


2 . STANDARDS 

(1)  The  Multics  runof f / runout  formatting  facility  is  to 
be  utilized  for  each  version  of  the  paper  which  is  to 
be  submitted  for  review. 

(2)  Run  the  text  segment  through  the  MULTICS  \M3RD  LIST 
facility  before  submission.  This  will  produce  a list 
of  all  possibly  misspelled  words  which  can  then  be 
changed.  The  syntax  for  invoking  the  WDRD  LIST 
facility  is: 

ec  >potluck>wl  segment ^name 

(3)  Refer  to  Harbrace  College  Handbook  for  any  problems 
with  English  granxnar.  One  will  be  placed  on  reserve  in 
Dupre  Library  for  the  use  of  all  authors. 

(4)  One  copy  of  all  work  cited  within  the  paper  should  be 
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submitted  with  the  initial  paper  review.  Book 
references  are  to  be  completely  labeled  in  the  upper 
left  hand  corner  with  the  author  names(s),  book  title, 
publisher,  city  of  publication  and  year.  Article 
references  are  to  be  labeled  with  the  author  name(s), 
article  n ame  , n ame  of  publication,  vol ume  and  n umb e r , 
and  month  year  of  publication.  Reference  articles 
should  be  completely  labeled  in  the  upper  left  hand 
corner  with  same  reference  information  which  is  to 
appear  in  the  reference  list.  Refer  to  PAPER  FORMAT 
s t andards . 

(5)  Two  copies  of  the  paper  are  to  be  submitted  on  a full 
dprint  (without  removing  margins), 

(6)  The  standard  naming  convention  for  paper  segments 
stored  on  Multics  will  take  the  form: 

DBMS  , NASA  / RECON-X  .runoff 
or 

D»4S  , NASA/  RECON-X  .archive 

as  appropiate,  where  X represents  the  paper  number 
within  the  Working  Paper  Series. 
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VIII.  REVIEW  GUIDELINES 


1 . INTRODUCTION 

The  following  notes  are  presented  with  the  objective  being 
to  make  the  reviewing  process  a more  effective  and  uniform 
effort.  These  guidelines  are  also  intended  to  formally  state  the 
procedure  which  reviewers  should  follow.  Included  in  these 
guidelines  are  reviewing  hints,  tasks  to  be  performed  and  MULT ICS 
p a t h n ame  s for  needed  doc  ume  n t s . 

2 . REVI EW  PHILOSOPHY 

It  is  hoped  that  the  review  process  will  result  in  a fair 
and  critical  evaluation  of  all  papers  involved.  The  success  of 
the  review  phase  is  essential  in  order  that  a quality  product  may 
result.  Standards  have  been  set  and  will  be  enforced  with  the 
idea  that  the  individual  papers  must  eventually  stand  side  by 
side.  Be  conscientious  and  honest  in  your  review  work.  Don’t 
shy  away  from  making  suggestions,  but  remember  to  be  tactful. 
Criticize  the  paper  not  the  author.  Review  with  a critical  eye 
and  an  open  mind.  Let’s  see  if  we  can  respond  to  this  task  in  a 
professional  way. 
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3.  REVIEWING  ENVIRONVlENT  ALGORITHM 

(1)  Find  a location  with  a peaceful  atmosphere. 

(2)  Allocate  enough  time  to  complete  the  reviewing  task  at 
one  sitting. 

(3)  Make  all  conments  at  the  time  of  review. 

4 . FEEDBACK 

Provide  as  much  feedback  as  possible.  If  some  aspect  of  the 
paper  is  inadequate  or  incorrect,  give  the  reasons  why  it  is  so 
and  perhaps  some  possible  solutions.  Feel  free  to  mark  the  paper 
text  with  notes  and  additionally  to  make  suggestions  on  the 
CCTvMENT  sheet  which  is  attached  to  the  REVIEWER  CHECKLIST. 

5 . STANDARDS 

Use  the  REVIEWER  CHECKLIST  as  a guide  in  evaluating  various 
issues  concerning  manuscript  content  and  organization.  Refer  to 
the  PAPER  FORMAT  document  as  a standard  for  paper  organization. 
YOU  ARE  DIRECTLY  RESPONSIBLE  FOR  THE  PAPER  THAT  YOU  REVIEW. 
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6.  REVIEW  PROCEDURE 

(1)  Receive  paper  manuscript  during  class  presentation. 

(2)  During  the  week  that  follows: 

(a)  Review  paper. 

(b)  Complete  REVIEWER  CHECKLIST. 

(c)  Complete  conment  sheet. 

(3)  At  next  class  return  to  the  editors: 

(a)  Reviewed  paper  (Destination  author). 

(b)  CCMvlENT  SHEET  (Destination  author). 

(c)  Signed  REVIEW  CHECKLIST  (De  s t ina  t i on  WDD)  . 


7 . DOCUMENTS 

The  following  dociunents  will  be  available  on  MJLTICS  and  may 
be  extracted  from  the  directory 

> udd  >DBMS  > NASA/ RECON > NASA  .work  i ng paper s e r i e s 

with  the  segment  name 

DH4S  . NASA/  RE(X)N . STANDARD  .archive 
in  NASA  .work  i ng ^paper s eries  .archive 
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DOCUVENT 


(1) 

INTRODUCTION 

(2) 

ABSTRACT  GUIDELINES 

(3) 

PAPER  OUTLINE 

(4) 

PAPER  FORMAT 

(5) 

SUBMISSION  POLICY 

(6) 

REVIEWER  GUIDE 

(7) 

REVIEWER  CHECKLIST 

(8) 

COMMENT  SHEET 
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REVIEWER  NAME DATE  RECEIVED_ 

AUTHOR  NAME DEADLIN"E  DATE_ 

REPORT  NUMBER DATE  CCMPLETED. 

VERSION  NUMBER 

T I TLE 


YES  SCME  NO 


REMINDER 


REVIEWER  CHECKS: 

[ ] [ ] [ ] 1 : We  re  all  references  to  other  wo  rk  read  before 

reviewing  the  paper?? 

[ ] [ ] [ ] Was  the  paper  THOROUGHLY  reviewed?? 

[ ] [ ] [ ] 3:  Was  feedback  provided  to  the  author  via  notes 

within  the  paper  and  attached  conment  sheet?? 

[ ] [ ] [ ] 4:  Did  you  understand  the  material  presented?? 

PAPER  CHECKS: 

[ ] [ ] [ ] Were  revisions  made  to  the  last  version?? 

(if  appl icable  ) 

[ 1 [ ] [ ] 2:  Was  the  English  language  properly  used? 

[ ] [ ] [ ] 3:  Any  misspelled  words?? 

[ ] [ ] [ ] 4:  Does  the  organization  of  the  paper  follow 

paper  format  standards?? 

[ ] [ ] [ ] 5:  Are  references  to  outside  literature  correctly 

c i ted?? 

[ ] [ 1 [ ] 6:  Is  the  reference  list  complete  and  accurate?? 
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[ ] [ ] [ ] 7: 

[][][]  8: 

[ ] [ 1 [ ] 9: 

[ ] [ ] [ ] 10: 

[ ] [ ] [ ] 11: 

[ ] [ ] [ ] 12: 

[ ] [ ] [ ] 13: 

[ ] [ ] [ ] 14: 

[ ] [ ] [ ] 15: 

[ ] [ ] ( ] 16: 

[ ] [ ] [ ] 17: 

[ ] [ ] [ ] 18: 

[ ] [ ] [ ] 19: 

[ ] [ ] [ 1 20: 

[ ] [ ] [ ] 21: 

[ ] [ ] [ ] 22: 

[ ] [ ] [ ] 23: 


REVIEWER  CHECKLIST 


Any  obvious  (or  s emi -obv i ou s ) plagiarism?? 

Any  technical  inconsistencies  between  writing 
and  works  cited?? 

Any  technical  inconsistencies  within  paper?? 

Are  figures  technically  correct  and  adequately 
referenced??( if  no,  go  to  comment) 

Are  tables  technically  correct  and  accurately 
re f e renc ed?? ( i f no,  go  to  comment) 

We  re  all  references  ma  de  available  to  you?? 

Can  reference  list  be  improved?? 

(if  yes,  go  to  c omme  n t s ) 

Any  missing  details??  (if  yes,  go  to 
c onane  n t s ) 

Any  extra  details??  (if  yes,  go  to  comnents) 

Is  paper  interesting?? 

(if  no,  go  to  coninents) 

Are  paper  objectives  defined  and  met?? 

(if  no,  go  to  coirments) 

Is  an  introduction  included?? 

Is  the  introduction  adequate?? 

(if  no,  go  to  comnents) 

Is  a sumnary  included? 

Is  the  sumnary  adequate?? 

(if  no,  go  to  comnents) 

Is  the  content  of  the  paper  clearly 
presented??  (if  no,  go  to  comnents) 

Is  the  abstract  sufficiently  brief  to  meet 
specified  length  requirements?? 

(100  to  250  words) 
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[]  []  []24:  Does  the  abstract  present  information  not 

contained  in  the  paper  rather  than  merely 
describe  what  is  in  the  paper??  (if  yes,  go 
to  conments) 

[ ] [ ] [ ] 25:  Does  the  abstract  provide  an  overview  of  the 

paper  (that  is,  does  it  explain  the  problem, 
method,  result,  conclusions,  and 

reconmendat ions )?? 

(if  no,  go  to  c omne  n t s ) 


SIGNATURE  OF  REVIEWER: 
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USL  / DBMS  NASA  / RECON 

WORKING  PAPER  SERIES 

Report  Number 
DBMS .NASA/RECON-1 


The  USL/DBMS  NASA/RECON  Working  Paper  Series  contains  a 
collection  of  reports  representing  results  of  activities  being 
conducted  by  the  Computer  Science  Department  of  the  University  of 
Southwestern  Louisiana  pursuant  to  the  specifications  of  National 
Aeronautics  and  Space  Administration  Contract  Number  NASW— 3846. 
The  work  on  this  contract  is  being  performed  jointly  by  the 
University  of  Southwestern  Louisiana  and  Southern  University. 


For  more  information,  contact: 


Wayne  D.  Dominick 
Editor 

USL/DBMS  NASA/RECON  Working  Paper  Series 
Computer  Science  Department 
University  of  Southwestern  Louisiana 
P.  0.  Boi  44330 
Lafayette,  Louisiana  70504 
(318)  231-6308 
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This  document  presents  a brief  overview  of  the  scope  of 
activities  being  undertaken  by  the  Computer  Science  Departments 
of  the  University  of  Southwestern  Louisiana  (USL),  Lafayette, 
Louisiana  and  Southern  University  (SU),  Baton  Rouge,  Louisiana 
pursuant  to  a contract  with  the  National  Aeronautics  and  Space 
Administration  (NASA).  This  document  will  present  only  basic 
identification  data  concerning  the  contract  activities  since 
subsequent  entries  within  this  Working  Paper  Series  will  be 
oriented  specifically  toward  a detailed  development  and 
presentation  of  plans,  methodologies,  and  results  of  each 
contract  activity. 


This  document  also  includes  a table  of  contents  of  the 
entire  USL/DBMS  NASA/RECON  Working  Paper  Series. 
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NASA  RECON: 

COURSE  DEVELOPMENT.  ADMINISTRATION.  AND  EVALUATION 


ABSTRACT 


This  research  and  development  proposal  addresses  the 
deve 1 opment , administration,  and  evaluation  of  a set  of 
transportable,  college-level  courses  to  educate  science  and 
engineering  students  in  the  effective  use  of  automated  scientific 
and  technical  information  storage  and  retrieval  systems,  and,  in 
particular,  in  the  use  of  the  NASA  RECON  system. 

After  a brief  introduction  to  the  research  and  development 
area  in  Chapter  I,  Chapter  II  identifies  the  general  and  specific 
objectives  for  this  project,  with  objectives  being  categorized  as 
needs  analysis  objectives,  course  development  objectives,  course 
admin istration  objectives,  and  course  e valua t ion  objectives. 
Chapter  III  then  proposes  the  methodology  to  be  employed  in 
successfully  accomplishing  these  objectives;  Chapter  IV 
highlights  the  expected  results  and  product  deliverables  of  this 
project;  and  Chap t e r V presents  the  project  evaluation  pi  an  to  be 
followed  in  evaluating  all  activities  and  deliverables  proposed 
within  this  project. 

Chapter  VI  presents  a brief  overview  of  the  institutional 
resources  available  at  the  proposing  institutions,  namely,  at  the 
University  of  Southwestern  Loui s i ana  and  at  Southern  University, 
to  support  this  project.  Chapter  VII  presents  the  proposed 
p r o j e c t budge  t , time  s chedu 1 e , and  p r o j e c t management  p 1 an  for 
this  project.  and  Chapter  VIII  summarizes  the  proposed  project. 
Finally,  resumes  of  the  Co-Principal  Investigators  for  this 
project  are  provided  in  the  appendices  to  this  proposal. 

We  be  1 i eve_  , th i s t o be  a sound  and  very  timely  research  and 
development  proposal  whose  results  should  be  extremely  beneficial 
within  both  current  and  future  NASA  scientific  and  technical 
information  environments. 
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I . INTRODUCTION 


There  appears  to  be  a growing  realization  that  recent 
college  graduates  in  scientific  and  engineering  disciplines  do 
not  have  the  experience,  skills,  and  motivation  necessary  to  take 
full  advantage  of  existing,  automated  systems  which  provide 
capabilities  for  searching  and  retrieving  scientific  and 
t e chni cal  inf  ormat i on . 

Massive  data  bases  of  bibliographic  information  are 
currently  available  and  accessible  via  online,  interactive 
systems.  For  example,  the  NASA  RECON  system  provides  such  access 
to  a variety  of  document  series  inlcuding,  among  others: 

* Scientific  and  Techni cal  Aerospace  Reports  ( STAR) 

* Limited  Scientific  and  Technical  Aerospace  Reports 
(LSTAR) 

’ International  Aerospace  Ab streets  ( I AA ) 

’ NASA  Research  and  Te chno logy  Operating  Plan  Summary 
(RTOPS) 

♦ Computer  Program  Abstracts  (CPA) 

♦ NASA  Library  Collection. 


This  research  and  devel opment 

proposal 

addresses 

the 

deye 1 opment , 

admini st  rat i on , 

and  evaluation  of 

a set 

of 

t ranspor t ab 1 e , 

, college-1  eve  1 

courses 

to  educate 

sci  ence 

and 

engineering  students  in  the  effective  use  of  automated  scientific 
and  technical  information  storage  and  retrieval  systems,  and,  in 
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particular,  in  the  use  of  the  NASA  RECON  system. 

As  a result  of  the  successful  comp letion  of  this  project,  we 
would  expect  that  a number  of  highly  significant  benefits  would 
accrue  to  NASA: 

(1)  Graduate  from  colleges  and  universities  sponsoring  such 
courses  would  have  gained  the  experience,  skills,  and 
motivation  necessary  for  the  effective  use  of  automated 
research  support  systems  and  of  the  NASA  RECON  system  in 
particular  and  hence  would  be  readily  suitable  to  work  with 
NASA.  Such  prior  experience  should  have  a positive  effect  on 
the  quality  of  research  conducted  by  incoming  NASA  employees 
and  should  minimize  required  training  time  by  NASA  in  such 
areas. 

(2)  NASA’s  sponsorship  of  such  courses  should  provide  much 
greater  visibility  for  NASA  in  colleges  and  universities 
where  NASA  would  be  likely  to  recruit. 

(3)  Having  research  faculty  in  science  and  engineering  at 
colleges  and  universities  become  familiar  with  RECON  and 
with  NASA  bibliographic  data  bases  should  facilitate 
contract  research  between  NASA  and  such  colleges  and 
universities . 
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In  order  to  ensure  the  success  of  this  project,  this 
proposal  is  being  submitted  jointly  by  the  University  of 
Southwestern  Louisiana  (a  university  with  a very  strong,  proven 
track  record  in  Computer  Science  research  and  development, 
especially  in  the  area  of  computer-based  information  system)  and 
Southern  University  (a  developing  institution  with  serious 
interests  in  enhancing  its  research  capabilities  in  Computer 
Sc i ence ) . 

Based  upon  the  historical  support  which  the  Computer  Science 
Department  at  USL  has  provided  to  Southern  University  to  expedite 
the  development  of  Computer  Science  curricula,  graduate  programs, 
faculty  capabilities,  and  research  competencies  at  Southern 
University,  this  joint  research  and  development  proposal  is  felt 
to  be  in  complete  concert  with  the  aims  of  the  National 
Aeronautics  and  Space  Administration  with  respect  to  support  for 
developing  institutions. 
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II.  PROJECT  OBJECTIVES 


The  intent  of  this  chapter  is  to  define  the  set  of  project 
objectives  which  will  structure  and  direct  all  of  the  activities 
to  be  performed  within  the  scope  of  this  proposed  project. 
Project  objectives  are  first  stated  in  general  terms  in  Section 
2.1  and  then  refined  into  specific  project  objectives  in  Section 
2.2. 

The  general  objectives  identified  for  this  proposed  project 
are  as  foil ows : 

(1)  General  Needs  Analysis  Objective:  The  conduct  of  a thorough 
needs  analysis  to  ascertain  the  specific  needs  of  target 
scientific  and  engineering  institutions  with  respect  to  the 
availability  of  transportable  courses  addressing  automated 
scientific  and  tecnhical  information  storage  and  retrieval 
systems,  in  particular,  the  NASA  RECON  system. 

(2)  General  Course  Development  Objective:  The  complete 

development  of  a set  of  transportable  courses  addressing 
automated  scientific  and  technical  information  storage  and 
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retrieval  systems  in  accordance  with  institutional  needs  as 
identified  within  objective  (l)  above. 

(3)  General  Course  Administration  Objective:  The  pilot 

a dm i n i s t r a t i on/ t e a ch i ng  of  the  courses  developed  within 
objective  (2)  above  on-site  at  the  proposing  institutions. 

(4)  General  Course  Evaluation  Objective:  The  comprehensive 

evaluation  of  each  activity  performed  and  each  deliverable 
produced  within  the  scope  of  this  project. 

2 . 2 

The  following  four  sub— sections  of  this  chapter  will  define 
the  specific  project  objectives  for  each  of  the  four  general 
project  objectives  identified  within  Section  2.1  above. 

2.2.1  An^lzs.ls. 

The  specific  project  objectives  associated  with  the  General 
Needs  .Analysis  Objective  identified  as  general  objective  (l)  in 
Section  2.1  are  as  follows: 

(1)  Identify  the  target  scientific  and  engineering  institutions 
to  be  surveyed.  It  is  expected  that  such  institutions 
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represent  current  and  possibly  potential  future  users  of 
RECON. 

(2)  Develop  a needs  identification  questionnaire  to  be 
a dm inistered  at  the  identified  target  institutions. 

(3)  Administer  the  needs  identification  questionnaire. 

(4)  Summarize  and  analyze  the  questionnaire  results  and  identify 
implications  of  needs  analysis  results  to  course  development 
activities. 

(5)  Prepare  an  interim  report  (Interim  Report  No.  1)  summarizing 
the  results  of  the  Needs  Analysis  phase  of  the  project  and 
submit  this  report  to  the  NASA  contract  monitor  for  review, 

2.2.2  Qhiaaiivfis 

The  specific  project  objectives  associated  with  the  General 

Course  Development  Objective  identified  as  general  objective  (2) 

in  Section  2.1  are  as  follows: 

(1)  Based  on  the  results  of  the  needs  analysis  phase  of  the 
project,  determine  specific  details  associated  with 
course(s)  design,  cont  ent , and  dur at  ion. 
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In  light  of  potential  diversity  of  needs  across  different 
institutions,  it  is  expected  that  there  may  well  be  the  need 
for  developing  a set  of  courses  (rather  than  a single 
course).  For  example,  there  may  well  be  the  need  for 
developing  each  of  the  following  courses  in  an  integrated 
manner : 

(a)  A full  semester  course  (approximately  18  weeks 
duration,  3 hours/week)  addressing  both  the  principles 
of  interactive  scientific  and  technical  information 
storage  and  retrieval  systems  and  integrating  numerous 
examples  utilizing  RECON  across  a variety  of  scientific 
and  engineering  disciplines. 

(b)  A mini  course  (approximately  6 weeks  duration,  3 
hours/week)  highlighting  selected  search  and  retrieval 
principles  and  illustrating  such  principles  utilizing 
RECON  examples  across  selected  scientific  and 
engineering  disciplines. 

(c)  A brief,  intensive  workshop  (1—2  day  duration) 
presenting  and  illustrating  the  most  important  commands 
and  capabilities  of  RECON. 

Throughout  the  remainder  of  this  proposal,  it  will  be 
assumed  that  an  integrated  set  of  courses  similar  to  those 
presented  above  will  need  to  be  developed. 
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(2)  Complete  development  of  all  transportable  course  materials 
for  the  integrated  set  of  courses  identified  within 
objective  (l)  above.  For  each  such  course.  this  will 
require  development  of  the  following  materials: 

(a)  Course  syllabus. 

(b)  Course  lesson  plans. 

(c)  RECON  homework  assignments. 

(d)  RECON  homework  assignments  - answer  keys. 

(e)  RECON  usage  assignments. 

(f)  RECON  usage  assignments  — answer  keys. 

(g)  Course  examinations. 

(h)  Course  examinations  - answer  keys. 

(i)  Course  visuals  (transparencies). 

(3)  Prepare  an  interim  report  (Interim  Report  No.  2)  summarizing 
the  results  and  deliverables  of  the  Course  Development  phase 
of  the  project  and  submit  this  report  to  the  NASA  contract 
monitor  for  review. 

2.2.3 

The  specific  project  objectives  associated  with  the  General 
Course  Administration  Objective  identified  as  general  objective 
(3)  in  Section  2.1  are  as  follows: 
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(1)  Perform  all  required  university  administrative  protocol 
functions  associated  with  the  offering  of  new  courses,  e.g. , 
prepare  course  descriptions  and  announcements,  coordinate 
course  scheduling  and  facility  reservations,  perform 
prospective  student  advisement,  and  the  like. 

(2)  Perform  all  activities  associated  with  the  actual  teaching 
of  the  courses,  e.g.,  lecturing,  RECON  demonstrations, 
grading  assignments  and  examinations,  maintaining  course 
office  hours,  advising  students,  scheduling  special  sessions 
and  RECON  demonstrations  as  required,  and  the  like. 

(3)  Prepare  an  interim  report  (Interim  Report  No.  3)  summarizing 
the  results  and  deliverables  of  the  Course  Administration 
phase  of  the  project  and  submit  this  report  to  the  NASA 
contract  monitor  for  review.  Depending  on  the  scheduling  of 
the  offerings  of  the  different  courses,  there  may  well  be  a 
series  of  Interim  Report  No.  3 documents,  with  each  document 
corresponding  to  one  offering  of  a course. 

2.2.4  EzAliiAiiiifl  QhXs.s.LxY&& 

The  spec  i f i.c  pro  j ect  obj  ect  ives  assoc  iated  with  the  General 
Course  Evaluation  Objective  identified  as  general  objective  (4) 
in  Section  2.1  are  as  follows: 
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(1)  Perform  ,a  comprehensive  evaluation  of  the  activities, 
results,  and  deliverables  associated  with  the  Needs  Analysis 
phase  of  the  project.  This  evaluation  will  be  incorporated 
within  Interim  Report  No.  1 as  referenced  within  Section 
2.2.1. 

(2)  Perform  a comprehensive  evaluation  of  the  activities, 

results,  and  deliverables  associated  with  the  Course 

Development  phase  of  the  project.  This  evaluation  will  be 
incorporated  within  Interim  Report  No.  2 as  referenced 

within  Section  2.2.2. 

(3)  Perform  a comprehensive  evaluation  of  the  activities, 

results,  and  deliverables  associated  with  the  Course 

Administration  phase  of  the  project.  This  evaluation  will 
be  incorporated  within  Interim  Report  No.  3 as  referenced 
within  Section  2.2.3. 

(4)  Perform  a comprehensive  evaluation  of  the  activities, 

results,  and  deliverables  associated  with  the  project  in  its 
entirity.  Together  with  a summary  of  all  such  activities, 
results,  and  deliverables,  this  final  comprehensive 

evaluation  will  constitute  the  Final  Report  of  the  project. 

As  an  expansion  of  these  evaluation  objectives.  Chapter  V 

presents  the  proposed  project  evaluation  plan. 
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III.  PROPOSED  PROJECT  METHODOLOGY 


In  the  interests  of  brevity,  this  chapter  will  address  only 
selected  components  of  the  proposed  methodology  for  this  project. 

In  particular,  since  the  needs  analysis  phase  of  this 
project  (see  Section  2.2.1,  entitled  "Needs  Analysis  Objectives") 
will  utilize  standard  needs  analysis  and  survey  questionnaire 
techniques,  no  additional  discussion  of  methodology  for  that 
phase  will  be  presented  in  this  chapter.  Additionally,  since  the 
course  administration  phase  of  this  project  (see  Section  2.2.3, 
entitled  "Course  Administration  Objectives")  will  parallel 
contemporary  teaching/administrative  techniques  for  courses 
providing  hands-on  experience  with  online,  interactive 

information  systems,  again,  no  additional  discussion  of 
methodology  for  that  phase  will  be  presented  in  this  chapter. 
Finally,  since  the  course  evaluation  phase  of  this  project  (see 
Section  2.2.4,  entitled  "Course  Evaluation  Objectives")  will  be 
addressed  within  Chapter  V,  entitled  "Project  Evaluation  Plan", 
no  additional  discussion  o f -me thodo 1 ogy  for  that  phase  will  be 
presented  in  this  chapter. 

This  chapter  will,  thus,  focus  on  selected  components  of  the 
course  development  phase  of  this  project  (see  Section  2.2.2, 
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entitled  "Course  Development  Objectives). 

The  primary  objective  of  the  course  development  phase  is  the 
complete  development  of  all  transportable  course  materials  for 
the  integrated  set  of  courses  to  be  developed  (again,  see  Section 
2.8.2  for  an  identification  of  the  expected  set  of  courses  to  be 
deve loped) . 

Within  this  context,  a set  of  standardized  course  material 
documentation  templates  will  be  employed  in  order  to  ensure 
standardization  between  the  proposing  institutions  during  course 
development  and  administration,  and  in  order  to  ensure 

transportability  of  all  course  deliverables  to  other 
institutions.  This  methodological  approach  has  proven  eminently 
successful  in  previously  funded  work  of  the  USL  Co-Principal 
Investigator  on  this  project  in  similar  environments,  in 

particular,  in  Department  of  Defense  funded  work  in  the  area  of 
transportable  co 1 1 ege— 1 eve  1 course  development. 

Standardized  course  material  documentation  templates  will  be 
utilized  across  all  of  the  following  course  materials: 

(a)  Course  syllabus. 

(b)  Course  lesson  plans. 

(c)  RECON  homework  assignments. 

(d)  RECON  homework  assignments  — answer  keys. 

( e ) RE CON  usage  assi gnment  s . 

( f ) RE CON  usage  assi gnment  s — answer  keys . 

(g)  Course  examinat ions. 

(h)  Course  examinat ions  — answer  keys. 

(i)  Course  visuals  (transparencies). 
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Ezanples  of  these  standardized  course  material  documentation 
templates  can  be  found  in  Appendix  C of  this  proposal. 
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IV,  EXPECTED  PROJECT  RESULTS  AND  DELIVERABLES 


The  expected  results  and  deliverables  of  this  project 
correspond  to  the  expected  successful  completion  of  each  of  the 
specific  project  objectives  identified  within  Sections  2.2,1 
through  2.2.4  of  this  proposal.  Since  those  objectives  were 
described  in  substantial  detail,  this  chapter  will  merely  present 
a brief  highlighting  of  the  major  deliverables  that  should  result 
from  the  successful  completion  of  those  objectives.  These  are  as 
foil ows : 

(1)  RECON  course  needs  identification  questionnaire.  With  minor 
modifications,  this  questionnaire  should  be  transportable  to 
other  NASA  system  needs  analysis  surveys. 

(2)  Summary  and  analysis  of  RECON  course  needs  analysis  survey. 

(3)  Complete  transportable  course  materials  for  an  integrated 
set  of  information  system  / NASA  RECON  courses,  including 
s t andardi zed : 

(a)  Course  syll abus . 

(b)  Course  lesson  plans. 

(c)  RECON  homework  assignments. 

(d)  RECON  homework  assignments  - answer  keys. 

(e)  RECON  usage  assignments. 

(f)  RECON  usage  assignments  ~ answer  keys. 

(g)  Course  examinations. 

(h)  Course  examinations  - answer  keys. 

(i)  Course  visuals  (transparencies). 
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(4)  Results  of  the  experience  of  the  pilot  administration  / 
teaching  of  each  of  these  courses  at  multiple  institutions. 

(5)  Comprehensive  evaluations  of  each  project  activity. 

(6)  Comprehensive  documentation  of  each  project  activity 
utilizing  standardized  and  transportable  documentation 
t emp 1 at  e s . 

It  is  felt  that  this  collection  of  expected  project 
deliverables  (and,  in  particular,  the  validated  transportability 
of  these  deliverables  across  the  two  proposing  institutions)  will 
be  of  very  significant  benefit  both  to  NASA  and  to  the  current 
and  potential  future  NASA  RECON  user  community. 
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V.  PROJECT  EVALUATION  PLAN 


It  is  our  intent  to  conduct  a thorough  evaluation  of  each 
component  of  this  proposed  project.  Our  evaluation  plan  consists 
of  a layered,  multi-level  evaluation  philosophy  wherein  each 
activity  within  each  project  phase  would  be  evaluated  at  least  at 
activity  completion  time  and,  for  major  activities  of  substantial 
duration,  also  at  appropriate  break  points  within  the  activity; 
wherein  each  phase  would  be  evaluated  in  its  entirity  at  phase 
completion  time  as  an  integration  of  ac t i v i t y— 1 eve  1 evaluations; 
and  wherein  the  total  project  would  be  evaluated  in  its  entirity 
at  project  completion  time  as  a summarative  integration  of 
phase-level  evaluations. 

Throughout  the  entire  pro j ec t , e va 1 ua t i on  r esu 1 1 s wi 1 1 be 
provided  to  the  NASA  contract  monitor  as  they  are  available  in  a 
series  of  project  interim  reports  and  the  project  final  report 
(see  Chapter  II  for  proposed  contents  and  timing  of  such 
reports ) . 

It  is  felt  that  the  specificity  provided  within  the 
identified  specific  objectives  for  each  project  phase  (Needs 
Analysis:  Section  2.2.1;  Course  Development:  Section  2.2.2; 
Course  Administration:  Section  2.2.3;  and  Course  Evaluation: 


I PROPOSAL  1 


I DBMS .NASA/RECON-2  | 


20 


I N A S A I 


I 01/16/84  I 


Section  2.2.4)  will  serve  as  an  excellent  baseline  for  the 
project  evaluation  plan.  In  fact,  our  evaluations  will  focus  on 
evaluating  our  success  in  achieving  each  stated  objective  and  on 
evaluating  the  transportability  and  g ene r a 1 i z ab i 1 i t y of  each  of 
the  deliverables  resulting  from  these  objectives. 

One  of  the  excellent  advantages  of  this  multi-institutional 
proposal  (involving  both  the  University  of  Southwestern  Louisiana 
and  Southern  University)  is  that  all  of  the  project  results  and 
deliverables  are  guaranteed  to  be  transportable  between  at  least 
two  institutions  (for,  if  they  are  not,  we  would  have  failed 
miserably).  Since  there  are  many  differences  between  these  two 
proposing  institutions,  we  must  certainly  develop  all  project 
products  in  a genera  1 i zed  and  transportable  manner  from  the  very 
onset  of  the  project.  With  this  motivation,  we  fully  expect  that 
all  of  the  deliverables  that  we  produce  as  a result  of  this 
project  work  will  be  completely  transportable  to  any  college  or 
university  that  currently  has,  or  can  be  provided  with  access  to 
the  RECON  system. 

Based  on  the  large  number  of  funded  grant  and/or  contract 
research  projects  that  have  been  directed,  either  individually  or 
jointly  by  the  proposed  Co— Principal  Investigators  for  this 
project,  we  feel  completely  confident  in  the  expected  quality  of 
our  final  deliverables  and  in  our  ability  to  thoroughly  evaluate 
such  deliverables. 
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VI.  OVERVIEW  OF  INSTITUTIONAL  RESOURCES 


This  chapter  will  present  a very  brief  overview  of  the 
institutional  resources  and/or  environments  available  at  the 
proposing  institutions  and  relevant  to  the  scope  of  the  proposed 
project.  For  the  purposes  of  this  proposal,  information  will  be 
presented  only  in  the  following  three  areas:  (1)  Computer 
Science  Department  programs,  students,  and  research  activities; 
(2)  University  and  Computer  Science  Department  computing 
facilities;  and  (3)  University  science  and  engineering  programs. 
Overview  information  will  be  presented  for  both  the  University  of 
Southwestern  Louisiana  (USL)  and  Southern  University  (SU) . 

USL  = 

A£iiviiij£5 

The  Computer  Science  Department  at  USL  offers  degree 
programs  at  the  B.S. , M.S. , and  Ph . D . levels.  Students  majoring 
in  Computer  Science  within  the  Department  during  the  1982—83 
academic  year  included  1,012  majors  at  the  B.S.  level;  113  majors 
at  the  M.S.  level;  and  46  majors  at  the  Ph . D . level. 

The  Department  is  extremely  active  in  advanced  research  and 
development  activities,  having  received  numerous  research  grants 
from  organizations  such  as  the  National  Science  Foundation,  the 
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National  Aeronautics  and  Space  Administration,  the  Army  Research 
Office,  the  Army  Corps  of  Engineers,  the  Office  of  Naval 
Research,  the  North  Atlantic  Treaty  Organization,  Texas 
Instruments,  and  many  others.  All  R&D  activities  in  the 
information  systems  area  are  coordinated  through  the  DBMS  (Data 
Base  Management  System)  Project,  a large-scale  R&D  project 
founded  in  October,  1975  by  the  USL  Co— Principal  Investigator  for 
this  proposed  project,  and  administered  under  the  auspices  of  the 
Computer  Science  Department  at  USL. 

USL  r find  UniBDnifir  Snifinnfi  EfiDfixiafini  UnaDiiiinfi 

Efifiiiiiififi 

The  major  University  computing  facility  consists  of  a three 
processor  Honeywell  68/80  MULTICS  system  with  twelve  megabytes  of 
main  memory.  This  is  one  of  the  most  powerful  and  sophisticated 
contemporary  time— sharing  systems  available.  The  Computer  Science 
Department  maintains  a Departmental  computer  laboratory 
consisting  of  a variety  of  minicomputer  and  microcomputer 
systems.  Additionally,  the  Department  has  recently  received 
approval  for  the  acquisition  of  two  DEC  VAX  11/780  systems, 
scheduled  for  installation  in  August,  1983. 
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USL  = Hsiver^iij  Science  nnd  En^iae exisfi  Ero^xam^ 

University  programs  in  science  and  engineering  are 
administered  under  the  auspices  of  the  College  of  Biological, 
Mathematical  and  Physical  Science  and  the  College  of  Engineering, 
respect ively. 

The  College  of  Biological,  Mathematical  and  Physical 
Sciences  is  comprised  of  the  following  Departments:  Biology, 
Chemistry,  Computer  Science,  Mathematics  and  Statistics, 
Microbiology.  and  Physics.  The  College  of  Engineering  is 
comprised  of  the  following  Departments:  Chemical  Engineering, 
Civil  Engineering,  Electrical  and  Computer  Engineering,  Geology, 
Mechanical  Engineering,  and  Petroleum  Engineering.  With  the 
exception  of  the  Departments  of  Biology  and  Microbiology,  the 
B.S.  curricula  for  all  of  the  above  departments  already  require 
at  least  one  course  in  Compu t er  Science. 

SU  - 

The  Department  of  Computer  Science  at  SU  offers  the  B.S. 
Degree,  with  350  majors  during  the  1982—83  academic  year. 
Add  i t i ona  1 l.y_,  .the  Department  has  received  approval  to  initiate  an 
M.S.  Degree  program  starting  with  the  Fall  Semester.  1983. 
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\ 

The  Department  has  maintained  a moderate  program  of  research 
during  its  15  year  history,  including  research  grants  received 
from  the  National  Aeronautics  and  Space  Administration,  Raytheon 
Data  Systems  Company,  Proctor  and  Gamble,  and  Bell  Laboratories. 
In  addition,  some  teachers  conduct  unfunded  research  projects. 

SlU  - Unlv.sr.aiix  nnd  Cnmnnisr  Srisnrs  Dsnsrirnsni  Hnanulin^ 
E&riiiiifix 

The  major  University  computing  facility  consists  of  an  IBM 
4341  system  with  four  megabytes  of  main  memory  which  supports 
both  batch  and  interactive  environments  for  its  users.  The 
Department  of  Computer  Science  administers  two  computing 
laboratories,,  with  a Raytheon  Data  Systems  Programmable  Terminal 
System  1200  (PTS/1200)  minicomputer  with  128  kilobytes  of  main 
memory  in  one  laboratory,  and  a Burroughs  Corporation  B1855 
computer  system  with  512  kilobytes  of  main  memory  in  the  other 
laboratory.  There  are  currently  two  microcomputers  in  the 
Department,  with  eight  additional  ones  scheduled  to  be  delivered 
June  1,  1983. 

SlU  = H£)i1x£j:.&11x  ££l£&££  £neln££rl&& 

University  programs  i-n  science  and  engineering  are 
administered  by  the  College  of  Sciences  and  the  College  of 
Engineering,  respectively.  The  College  of  Sciences  is  comprised 
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of  the  Departments  of:  Biology,  Chemistry,  Computer  Science, 
Geography,  Health  Research,  Ma  t h ema  tics,  Phy  s ics.  Psychology, 
Sociology,  and  Speech  Pathology  and  Audiology.  The  College  of 
Engineering  is  comprised  of  the  Division  of  Technology  and  the 
Departments  of:  Architecture,  Civil  Engineering,  Electrical 
Eng ineering,  and  Mechanical  Eng ineering.  Begi nning  with  the  Fall 
Semester,  1963,  all  areas  referenced  above  will  require  a minimum 
of  one  course  in  Computer  Science. 
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VII.  PROPOSED  PROJECT  BUDGET, 

TIME  SCHEDULE,  AND  PROJECT  MANAGEMENT  PLAN 


The  following  three  sub— sections  of  this  chapter  present 
respectively  the  proposed  project  budget,  the  proposed  project 
time  schedule,  and  the  proposed  project  management  plan. 

7 • 1 Blii&ei 


The  budget  for  the  proposed  project  is  presented  on  page  30. 
Various  notes  to  the  budget  are  explained  below. 


SALARIES  AND  WAGES: 


Senior  Personnel: 

Wayne  D.  Dominick:  $4583/mo.  (12  months 
Leroy  Roquemore:  $37B9/mo.  (12  months 
(Salary  increases  of  15%  for  Year  2 are 


at  40%  t ime ) . 
at  40%  t ime ) . 
inc luded . ) 


Other  Professional  Personnal: 

USL  Research  Assistants:  2 at  $7200/yr, 

SU  Research  Assistants:  2 at  $5600/yr. 

(Salary  increases  of  10%  for  Year  2 are  included.) 


Non-Professional  Personnal : 

Seer etar i a 1— C 1 er i cal : 1/4— time  at  each  institution  at 

$10000/yr . 

(Salary  increases  of  10%  for  Year  2 are  included.) 


STAFF  BENEFITS: 

Staff  benefit  rate  at  USL  is 
Staff  benefit  rate  at  SU  is 


11.3%  of  salaries  and  wages. 
13.0%  of  salaries  and  wages. 
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INDIRECT  COSTS: 

Indirect  cost  rate  at  USL  is  47%  of  salaries  and  wages. 
Indirect  cost  rate  at  SU  is  45%  of  salaries  and  wages. 

EXPENDABLE  MATERIALS  AND  SUPPLIES: 

Transparencies,  te rmina I paper  and  ribbons,  paper,  etc. 

TRAVEL : 

Trips  to  NASA,  Washington,  D.C.: 

6 person  trips  in  Year  1 (3  each  institution);  4 trips  to 
attend  RECON  training  sessions;  8 trips  to  present  Year  1 
reports  to  NASA.  4 person  trips  in  Year  2 (2  each 
institution)  to  present  Year  2 interim  report  and  project 
final  report  to  NASA.  Travel  at  $725/trip  (air  fare,  motel 
(2  days),  meals,  taxi,  etc.). 

Trips  Between  Proposing  Institutions: 

24  person  trips  per  year  (12  each  institution);  1 per  month 
per  institution.  Travel  at  $50/trip  (car  mileage,  meals). 

COMPUTER/COMMUNICATIONS  COSTS: 

Computer  Terminals  Purchase : 

6 HP  2621B  terminals  (3  each  institution)  for* RECON  usage. 
Purchase  price  of  $2855/terminaI . All  terminal  purchases 
will  occur  in  Year  1. 

Compute r Terminal  Maintenance : 

Maintenance  on  6 terminals  (3  each  institution)  at  $32/mo. 
for  5 months  during  Year  1 and  12  months  during  Year  2. 
Modem  Lease  Costs: 

2 modems  (l  each  institution)  at  $40/mo.  lease  for  5 months 
during  Year  1 and  12  months  during  Year  2. 

Cabling:  Modems  to  Terminals: 

6 terminals  (3  each  institution);  $70/terminal  for  cabling. 
One-time  charge  in  Year  1. 

Connect  Time/Line  Charges: 

Year  .1  will  require  -100  hours  development  time  (50  hours 
each  institution)  and  44  hours  instructional  t ime  for 
conduct  of  RE CON  workshops  at  each  institution  (22  hours 
each  institution);  total  of  144  hours  connect  time/line 
charges  in  Year  1.  Year  2 will  require  1100  hours 
instructional  time  for  conduct  of  RECON  6— week  course  and 
RECON  18— week  course  at  each  institution  (550  hours  each 
institution).  Charge  rates  for  components  of  connect 
time/line  charges  are  as  foil ows : 
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• NASA  Host  System  Connect  Time: 

• TELENET  Line  Charges: 

• Telephone  to  TELENET  Node  Charges: 

(lor  Band  5 WATS  Line) 

Local  Word  processing  Costs: 

Document  preparation  at  each  institution. 

OTHER  DIRECT  COSTS: 

Tel ephone : 

Verbal  communication  between  institutions  and  to  NASA. 
Photocopying/Postage: 

Written  communication  between  institutions  and  to  NASA. 


$20/hr  . 
$7/hr  . 

$20 .21/hr 
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B U D G E T 


YEAR  1 
10/01/83  - 09/30/84 


YEAR  2 


TOTAL 


10/01/84  - 09/30/85  10/01/83  - 09/30/85 


SALARIES  AND  WAGES: 

Senior  Personnel: 

Wayne  D . Dominick 
Leroy  Roquemore 

Other  Professional  Personnel: 
Research  Assistants  (4) 

Non-Professional  Personnel: 
Secretarial-Clerical 

Total  Salaries  and  Wages 

STAFF  BENEFITS: 

USL:  11.3% 

SU  ; 13.0% 

TOTAL  SALARIES,  WAGES  AND 
^^AFF  BENEFITS 


^TA 


INWRECT  COSTS: 

USL:  47% 

SU  : 45% 

EXPENDABLE  MATERIALS  AND  SUPPLIES 

TRAVEL: 

Trips  to  NASA 
Trips  Between  Proposing 
Institutions 
Total  Travel 

COMPUTER/COMMUNICATIONS  COSTS: 
Computer  Terminals  Purchase 
Computer  Terminal  Maintenance 
Modem  Lease  Cost 
Cabling:  Modems  to  Terminals 
NASA  Host  System  Connect  Time 
TELENET  Line  Charges 

• Telephone  to  TELENET  Nodes 
Local  Word  Processing  Costs 
Total  Coraputer/Communications 

OTHER  DIRECT  COSTS: 

Telephone 

Photocopying/Postage 
Total  Other  Direct  Costs 

TOTAL  PROJECT  COSTS 


USL 

j SU 

TOTAL 

USL 

SU 

TOTAL 

USL 

SU 

TOTAL 

21998 

18187 

40185 

25298 

20915 

46213 

47296 

39102 

86398 

14400 

11200 

25600 

15840 

12320 

‘28160 

30240 

23520 

53760 

2500 

2500 

5000 

2750 

2750 

5500 

5250 

5250 

10500 

38898 

31887 

70785 

43888 

; 35985 

79873 

82786 

67872 

150658 

43293 


4145  8540  4959 

36032  79325  48847 


18282 

14349 

32631 

1000 

1000 

2000 

2175 

2175 

4350 

600 

600 

1200 

2775 

2775 

5550 

8565 

8565 

17130 

480 

480 

960 

200 

200 

400 

210 

210 

420 

1440 

1440 

2880 

504 

504 

1008 

1455 

1455 

2910 

1000 

1000 

2000 

13854 

13854 

27708 

500 

500 

1000 

500 

500 

1000 

1000 

1000 

2000 

80204 

69010 

149214 

4678  9637  9354  8823  18177 

40663  89510  92140  76695  168835 


1152 

1152 

2304 

480 

480 

960 

0 

0 

0 

11000 

11000 

22000 

3850 

3850 

7700 

11116 

11116 

22232 

1000 

1000 

2000 

28598 

; 28598 

57196 

500 

500 

1000 

1000 

1000 

2000 

1500 

1500 

3000 

103122 

90504 

193626 

38909 

30542 

69451 

2500 

2500 

5000 

3625 

3625 

7250 

1200 

1200 

2400 

4825 

4825  , 

9650 

8565 

8565 

17130 

1632 

1632  ■ 

3264 

680 

680 

1360 

210 

210 

420 

12440 

12440 

24880 

4354 

4354 

8708 

12571 

12571 

25142 

2000 

2000 

4000 

42452 

42452 

84904 

1000 

1000 

2000 

1500 

1500 

3000 

2500 

2500 

500C 

183326 

159514 

342840  i 
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7 . 2 Use  Sih^diiie 

The  time  schedule  for  the  proposed  project  is  presented  on 
page  32. 

As  illustrated  in  the  time  scheduling  diagram,  this  project 
is  proposed  to  span  a period  of  two  years,  with  an  October  1, 
1983  start  date  and  a September  30,  1985  completion  date. 

Within  the  scheduling  diagram,  great  care  has  been  exerted 
to  ensure  that  the  scheduling  of  each  project  phase  appropriately 
coincides  with  typical  university  academic  year  and  semester 
periods  in  order  to  ens'ure  compatibility  • o.l^r.;  "the;^-^^^^^^  work 
with  previously  established  university  teaching  schedules. 

The  diagram  also  illustrates  the  timing  of  the  preparation 
and  submission  of  the  project  interim  reports  and  the  project 
final  report.  Interim  Report  No.  1 occurs  at  the  end  of  the 
sixth  month  and  Interim  Report  No.  2,  occurring  at  the  end  of  the 


twe 1 vth 

month , 

will  also  serve  as 

the 

end 

o f 

year 

1 

report . 

Interim 

Report  No.  3 occurs 

at 

the 

end 

o f 

the 

Course 

Admin i s t r at i on 

Phase,  and  the  final 

report 

occurs 

at 

the 

end  0 f 

the  twenty-fourth  month. 
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TIME  SCHEDULE 
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A* 

NEEDS  ANALYSIS  PHASE 
..Attend  NASA  RBCON  Workshops. 
..Identify  Target  Institutions. 
..Develop  Needs  Analysis  Questionnaire. 
..Survey  Targeted  Institutions. 
..Analysis  of  Questionnaire  Results. 
..Evaluation  of  Phase  Activities. 
..Interim  Report  No.  1. 

COURSE  DEVELOM<ENT  PHASE 
...Prepare  Course  Approval  Documents. 
.Secure  Course  Approvals. 


..Procure  RECO J Terminal  Equipment. 

..RECON  Homework  Asst/Ans%rer  Key  Develop- 
ment! R/WK,  R/6,  R/IB. 

..RECON  Usage  Asst/Answer  Key  Develop- 
mentx  R/MK,  R/6,  R/18. 

. .Bxaaination/Answer  Key  Developsienti 
R/WK,  R/6,  R/lfl. 

..Visuals  Development:  R/WK,  R/6,  R/18. 

. .Schedule  Courses:  R/WK,  R/6,  R/18. 
..Evaluation  of  Phase  Activities. 

..Interim  Report  No.  2. 

COURSE  ADMINISTRATION  PHASE 
..Advise  Prospective /Enrol led  Students. 
.Implement  RECON  Course:  R/WK  {21. 
.Implement  RECON  Course:  R/6. 

.Implement  RECON  Course:  R/18. 

.Evaluation  of  Phase  Activities. 

.Interim  Report  No.  3. 

FINAL  EVALUATION  PHASE 
.Conduct  Summarative  Evaluation  of  Project. 
.Final  Report. 
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7 . 3 Ero j.e ci  Elaa 

The  Co-Principal  Investigators  will  assume  both  joint 
p r o j e c t- 1 ev e 1 responsibilities  and  individual  ins t i tut i ona 1- 1 eve  1 
responsibilities. 

From  the  standpoint  of  overall  project  management,  the 
Co— Principal  Investigator  responsibilities  will  include  overall 
p r o j e c t — 1 e V e 1 planning,  control,  monitoring  of  progress  toward 
defined  plans/schedules,  budget  administration,  and  coordination 
and  integration  of  all  inst i tut i onal  — 1 eve  1 activities  and 
deliverables.  They  will  also  be  jointly  responsible  for  the 
evaluation  of  all  project  methodologies  and  results,  for  the 
preparation  of  all  interim  reports  and  the  final  project  report, 
and  for  all  coordination  with  the  funding  agency. 

From  the  standpoint  of  ins t i tut ional  — 1 eve  1 project 
management,  each  Co-Principal  Investigator  will  assume  complete 
responsibility  for  the  conduct  of  each  project  task  at  his 
respective  institution.  Each  will  also  assume  responsibility  for 
ensuring  that  all  of  the  tasks  performed  at  his  institution  are 
completed  in  accordance  with  defined  pr o j ec t— 1 e ve 1 standards 
concerning  general izabi 1 i ty  and  transportability.  Additionally, 
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each  will  serve  as  a project  consultant  to  the  other  to  assist  in 
resolving  any  difficulties  that  may  occur  at  one  institution  or 
the  other . 

In  light  of  the  developing  nature  of  Southern  University 
with  respect  to  Computer  Science  research  and  development  and  the 
strong  and  proven  expertise  of  the  University  of  Southwestern 
Louisiana  in  such  activities,  it  is  felt  that  this  joint  project 
management  plan  is  essential  in  order  to  ensure  the  success  of 
this  project. 
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VIII.  SUMMARY  OF  PROPOSED  PROJECT 


This  research  and  development  proposal  has  addressed  the 
development,  administration,  and  evaluation  of  a set  of 
transportable,  college-level  courses  to  educate  science  and 
engineering  students  in  the  effective  use  of  automated  scientific 
and  technical  information  storage  and  retrieval  systems,  and,  in 
particular,  in  the  use  of  the  NASA  RECON  system. 

After  a brief  introduction  to  the  research  and  development 
area  in  Chapter  I,  Chapter  II  identified  the  general  and  specific 
objectives  for  this  project,  with  objectives  being  categorized  as 
needs  analysis  objectives,  course  development  objectives,  course 
administration  objectives,  and  course  evaluation  objectives. 
This  collection  of  objectives  is  felt  to  represent  an  excellent 
structure  and  framework  for  the  conduct  of  the  proposed  project. 

Chapter  III  then  outlined  the  proposed  methodology  to  be 
employed  in  successfully  accomplishing  these  objectives.  Based 
on  the  success  of  numerous  past  and  present  joint  grant 
activities  between  the  proposing  Co— Principal  Investigators,  this 
methodology  is  believed  to  be  sound,  realistic,  and  achievable 
within  the  scope  of  this  project. 
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Chapter  IV  highlighted  the  expected  project  results  and 
product  deliverables  associated  with  the  completion  of  this 
project,  and  Chapter  V presented  the  evaluation  plan  to  be 
followed  in  order  to  ensure  a comprehensive  evaluation  of  all 
activities  and  deliverables  proposed  within  the  scope  of  the 
project. 

Chapter  VI  presented  a very  brief  overview  of  the 
institutional  resources  available  at  the  proposing  institutions 
to  support  this  project.  It  is  felt  that  these  resources  are 
more  than  adequate  to  provide  an  effective  environment  for  the 
successful  conduct  of  the  proposed  activities. 

Chapter  VII  presented  the  proposed  project  budget,  time 
schedule,  and  project  management  plan.  Based  on  the  magnitude  of 
the  activities  and  deliverables  comprising  this  proposed  project, 
it  is  felt  that  both  the  budgetary  and  the  scheduling  figures 
presented  are  most  realistic. 

Finally,  resumes  of  the  Co— Principal  Investigators  for  this 
project  are  provided  in  the  appendices  to  this  proposal. 

Both  the  University  of  Southwestern  Louisiana  and  Southern 
University  look  forward  to  a favorable  review  of  this  proposal 
and  to  providing  these  services  to  the  National  Aeronautics  and 
Space  Admin istration. 
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Resume 


Wayne  D,  Dominick 


03/83 


University  of  Southwestern  Louisiana 

Computer  Science  Department 

P,  0.  Box  44330 

Lafayette,  Louisiana  70504 

(318)  231-6604 


United  States  Citizen 
Birthdate  19  October  1946 
Birthplace:  Chicago,  Illinois 

Associate  Professor  of  Computer  Science,  University  of 
Southwestern  Louisiana,  1977-p resent. 


Planning  and  administration  of  information  system  environments 

Management  information  system  design 

Data  base  management  system  design 

Information  storage  and  retrieval  system  design 

Software  monitoring  and  system  performance  evaluation 

User/system  interfacing 

Interactive  graphics  for  data  base  systems. 

B.S.,  Mathematics.  Illinois  Institute  of  Technology,  1966. 
M.S.,  Computer  Science,  Northwestern  University.  1974. 

Ph.D.,  Computer  Science,  Northwestern  University,  1975. 
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Wayne  D.  Dominick  (Continued) 


03/83 


Long  Range  Planning  Consul tant , Offices  of  Planning  & Research, 
OCLC,  Inc.,  Dublin,  Oh.,  1 982~pr e s ent . 

Member  and  program/curriculum  consultant,  Graduate  Program 
Advisory  Council,  Department  of  Computer  Science,  Southern 
University,  Baton  Rouge,  La.,  1982-present. 

President,  Executive  Systems,  Incorporated,  Lafayette,  La., 
198 1— pr  e sent. 

Computer  systems  performance  measurement  and  evaluation 
consultant.  Computer  Systems  Engineering  Department,  OCLC, 
Inc.,  Dub  1 i n , Oh . , 198  0— p resent . 

Data  base  technology  consultant,  Tenneco  Oil  Exploration  and 
Production,  Houston.  Texas.  1980-1981. 

Information  systems  planning  and  development  consultant, 
D e V e 1 o pmen  t Division,  OCLC,  Inc.  , Dub  1 i n , Oh .,  1980— present. 

Computer  assisted  instruction  consultant.  College  of  Sciences, 
Southern  University,  Baton  Rouge,  La.  (NSF  Minority 
Institutions  Science  Improvement  Program:  Individualized 

Institutional  Project  Grant).  1980-present. 

Reviewer,  Annual  Review  of  Information  Science  and  Technology, 
1980-present . 

Scientific  Services  Program  (STAS)  consultant.  Directorate  of 
Training  Development,  U.  S.  Army  Signal  Center  & Fort  Gordon, 
Fort  Gordon,  Ga . , (administered  through  Battelle  Colximbus 
Laboratories) , 1979-1981 . 

Vice-President,  Optimum  Information  Systems,  Inc.,  Columbus, 
Oh. , 1979-present. 

Management  information  system  consultant.  State  of  Louisiana, 
Department  of  Education,  Office  of  Research  & Development, 
Baton  Rouge,  La..  1978-present. 

Vi ce— Pres i dent/Secr et ary , Information  Management,  Inc. , 

Lafayette.  La.,  1978-present. 

Member,  Special  Interest  Group  Steering  Committee,  ASIS, 
1978-1979 . 

Info rmat i on  system  mon itoring  consultant.  Office  of  Research 
(formerly  Research  Department),  OCLC,  Inc.,  Dublin,  Oh., 
1978-present . 

Grant  Proposal  Reviewer,  National  Science  Foundation, 
Washington,  D.  C.,  1978— present . 

Book  Reviewer,  Journal  of  the  American  Society  for  Information 
Science,  ASIS,  1 978— pr e s ent . 

Chairman,  Special  Interest  Group  on  Numeric  Data  Bases,  ASIS, 
1977-1978 . 

Chairman,  Graduate  Studies  Committee,  Computer  Science 
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Department,  University  of  Southwestern  Louisiana,  1977-1979. 

Member,  Executive  Committee,  Computer  Science  Department, 
University  of  Southwestern  Louisiana,  1977-1982. 

Assistant  Professor  of  Computer  Science,  University  of 

Southwestern  Louisiana,  1975-1977. 

Cha i rman— e 1 e c t , Special  Interest  Group  on  Numeric  Data  Bases, 
ASIS,  1976-1977. 

Newsletter  editor,  Special  Interest  Group  on  Numeric  Data 
Bases,  ASIS,  1976-1977. 

Speaker,  USL  Speakers  Bureau,  University  of  Southwestern 
Louisiana,  Lafayette,  Louisiana,  1976—1981. 

Data  base  system  consultant,  CODATA  Task  Group  on  Computer  Use, 
1976— present . 

Curriculum  and  data  base  system  consultant,  Department  of 
Computer  Science,  Southern  University,  Baton  Rouge,  La.  (HEW 
Advanced  Institutional  Development  Program  Grant),  1976-1981. 

Data  base  system  consultant,  Battelle  Columbus  Laboratories, 
Columbus,  Ohio,  1976-1977. 

Data  base  management  system  and  information  storage  and 
retrieval  system  publications  reviewer  for  major  Computer 
Science  conferences,  1976-present. 

Computer  Science  manuscript  reviewer,  Allyn  and  Bacon,  Inc., 
Boston,  Ma . , 1976-present. 

Founder  and  Director  of  the  DBMS  (Data  Base  Management  System) 
Project,  University  of  Southwestern  Louisiana,  Lafayette, 
La.,  1975-present. 

Energy  Management  Program  Consultant,  State  of  Louisiana, 
Department  of  Conservation,  Natural  Resources  and  Energy 
Division,  Baton  Rouge,  La.,  1975-1977. 

U.  S.  Army  Corps  of  Engineers  Consultant,  Champaign,  111., 
Washington,  D.C.  and  Vicksburg,  Miss.,  1975-1977. 

Data  base  system  consultant,  Vogelback  Computing  Center, 

Northwestern  University,  Evanston,  111.,  1975-1977. 

Private  consultant  for  management  information  system  design, 
Evanston,  111.  and  Lafayette,  La.,  1971-present. 

Royal  E.  . Cabell.  Fellow,  Department  -of  Computer  Science, 

Northwestern  University,  Evanston,  111.,  1974-1975. 

Information  services  programmer,  Vogelback  Computing  Center, 
Northwestern  University,  Evanston,  111.,  1971-1975. 

Systems  Analyst,  U.  S.  Army  Personnel  Information  Systems 
Command,  The  Pentagon,  Washington,  D.C.,  1969—1970. 

Progranimer,  Department  of  Mathematics,  Illinois  Institute  of 
Technology,  Chicago,  111.,  1967-1968. 
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Wayne  D.  Dominick  (Continued) 
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American  Soci 
Special  Int 
Special  Int 
Special  Int 
(SIGED) 


ety  for  Info 
erest  Group 
erest  Group 
erest  Group 


rmation  Science  (ASIS) 
on  Numeric  Data  Bases  (SIGNDB) 
on  User  On-Line  Interaction  (SIGUOI) 
on  Education  for  Information  Science 
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SIGMETR 

I 

CS) 

Machinery  (ACM) 

on  Management  of  Data  (SIGMOD) 
on  Information  Retrieval  (SIGIR) 
on  Graphics  (SIGGRAPH) 
on  Measurement  and  Evaluation 


Human  Factors  Society  (HFS) 
Computer  Systems  Group  (CSG) 


"Deve loping 
Ret  r i eva 1 
B£l£l££hl 
pp.  297-3 


Monitoring  Techniques  for  an  On-Line 
System,"  (with  B.  Mittman),  Informat  ion 
Ill££rx  find  Erfi£ii££.  Vol.  9.  No.  6, 

07  . 


Inf  ormat i on 
Si££fi££  find 
June , 1973, 


"Interactive  Graphics  Enhancements  for  Information  Retrieval 

Systems,"  (with  B.  Mittman),  Proc . A£M-  1973  Annual 

Conference,  1973,  p.  434. 


"Information  Retrieval  System  Cost/Performance  Analysis  via 
Interactive  Graphics,"  (with  B.  Mittman),  Proc.  ASIS.  Vol. 
10,  1973  Annual  Meeting,  1973. 


BlfiS  - XBfimnifi  Inlnrsifillnn  fiu£xx  BxfilfimI  Efifilurn  Anfilxfiln . 
Technical  Report,  Vogelback  Computing  Center,  Northwestern 
University,  Evanston,  111.,  April,  1973,  45p. 


BlfiB  - B£D£l£  InlfiJiDfillnn  fiu££X  BXfilfiffi  Ufi£££  Mfinufil.  (with  L. 
Borman,  R.  Chalice,  D.  Dillaman,  P.  Kron) , Technical  Report, 
Vogelback  Computing  Center,  Northwestern  University, 

Evanston,  Illinois,  July,  1975,  262p. 

Ih£  Mfin/Mfi£hln£  Inl££lfi££,  Bxfilfiffi  Mnnllnrlnfi  find  Efirlnrmfinnfi 
Bxfilufillnn  Mfilhndnlnfix  I&l  Qa=Lla£  lnl£rfi£tlv£  Sxfilfimfi . M . S . 
Thesis,  Department  of  Computer  Science,  Northwestern 

University,  Evanston,  Illinois,  June,  1974,  98p. 
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EiSSQMLIME  Mjaniiar  fiad  EISELSG  Aaaliaia  Project,  (with 
R.  Witt),  Technical  Report,  Vogelback  Computing  Center, 
Northwestern  University,  Evanston,  Illinois,  August,  1974, 
38p  . 


lli£  BIQSQNLINE  Eraaaiara  Eraaaaaiaa  Capabi  1 i ty . Technical 
Report,  Vogelback  Computing  Center,  Northwestern  University, 
Evanston,  Illinois,  August,  1974,  14p. 


BlfiESELINE  lalaraallsa  Snachlaa 
Vogelback  Computing  Center, 
Evanston,  Illinois,  August,  1974, 


Ea£kh££ . Technical  Report, 
Northwestern  University, 
9p. 


ElflSIUlQE  - 
Voge  Iback 
Evanston, 


A £A1  lalaillal  Xar  ElfiEQHLlEEi  Technical  Report, 
Computing  Center,  Northwestern  University, 
Illinois,  August,  1974,  5p . 


"Administrative  Data  Management  in  a University  Environment," 
(with  D.  Mintzer),  E£r£fiafiii££d  E£i£  B£££  Systems . B. 
Mittman,  L.  Borman  (editors),  John  Wiley  & Sons,  Inc.,  1975, 
Chapter  9,  pp . 169-185. 


"System  Performance  Evaluation  of  Interactive  Retrieval,"  in 
E££££ll£ll2.'£ii  D&l£  S£££  Systems . B.  Mittman,  L.  Borman 
(editors),  John  Wiley  & Sons,  Inc.,  1975,  Chapter  12,  pp . 
216-227 . 


"Selective  Retrieval 
Ana  lysis  of  Ski n 
E£l£  E£££  EX£l£l&£. 
Wiley  & Sons,  Inc. 


, Statistical  and 
Biopsy  Data,"  (with 
B . Mi t tman , L . 

, 1975,  Chapter  15, 


Inter 
F . Lev 
Borman 
pp  . 25 


active  Graphical 
it),  E£Il££&£ll££4 
(editors) , John 
1-263  . 


M£d£l£  l££  fi££clil££llx~EnhAa££d  CaIa  Baa£  MA&A££m£Al  System 
BaaXaa • Ph . D . Dissertation,  Department  of  Computer  Science, 
Northwestern  University,  Evanston,  Illinois,  June,  1975, 
214p. 

"Personalized  Management  and  Graphical  Display  of  Data:  An 

Extensible  System  Approach,"  (with  L.  Borman,  R.  Hay,  Jr.,  P. 

Kron,  B M i ttman ) , • Er££££diA£A  flX  ±h£  larkshop  an  EaXa  Bases 

XaX  X&X££A£XXX£  EaaXaa • Waterloo,  Ontario,  Canada,  September, 
1975,  pp.  36-44. 
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"The  DBMS  Project  — Interdisciplinary  Research  in  Data  Base 
Management  Systems."  Ero£££din£fi  M££lia£  fll  ih£ 

LfiHlalanh  A£&d£ffi£  S.1  . February  5-7  , 1976,  Baton 

Rouge , La . 

"A  Methodology  for  Designing  Graphically-Enhanced  Data  Base 
Management  Systems."  Er££££din££  Ifilfi  fil  itl£ 

Laulalfiaa  As.&Asmx  al  E£l£a£££.  February  5-7,  1976,  Baton 

Rouge , La . 

"Automated  Aids  for  Managing  and  Eyaluating  a Data  Base  System 
Environment,"  (with  M.  H.  McKinney),  Proceedings  o f th^  filth 
El£aalal  lai£ra£il£a£l  CQDAIA  ££al£££a££.  University  of 
Colorado,  Boulder.  Co.,  June  28  - July  1,  1976,  pp . 497-499. 

"User/System  Interfacing  in  an  Interactive  Retrieval, 

Statistical  and  Graphical  Analysis  Environment,"  (with 
Lorraine  Borman),  S.L  Lh&  LllLh  Mid-Ixar 

Q.1  1q,l  Inlora&iifin  May  20-22. 

1976 , pp . 34-49 . 

I Speak  as  an  Information  Professional,"  ASIS  Career  Profile 
Contest  winning  paper  presented  at  the  Fifth  Mid-Year  Meeting 
of  the  American  Society  for  Information  Science,  Vanderbilt 
University,  Nashville,  Tenn.,  May  20-22,  1976,  26p . 

O.L  EIQS  - lalfirffijaiian  fiuerx  Sxsi£m,  Technical 

Report  CMPS— 76— 6-1 , Computer  Science  Department,  University 
of  Southwestern  Louisiana,  Lafayette,  Louisiana,  April,  1976. 
44p  . 

SXXiXBi  (with  Daniel  W.  Pipkins),  Technical  Report 
CMPS— 76— 6— 2,  Computer  Science  Department,  University  of 
Southwestern  Louisiana,  Lafayette,  Louisiana,  May,  1976,  62p. 

BDBME  - Bxl&ll^n&I  D&1&  £&££ 

(with  Daniel  W.  Pipkins),  Technical  Report  CMPS-76— 6-3, 
Computer  Science  Department,  University  of  Southwestern 
Louisiana.  Lafayette .Louis iana.  May,  1976,  24p. 
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CIS  - C£ni£rea££  inlsrmaiifin  Siaiso  CaassaiA.  (with 

Ginger  Chauvin  and  Christie  D.  Parker),  Technical  Report 

CMPS— 76— 6— 4,  Computer  Science  Department,  University  of 
Southwestern  Louisiana,  Lafayette,  Louisiana,  May,  1976, 
Revision  1,  May  1977,  87p. 

fiu££x  £aQ£l£2llx  la  Calfi  Saaa  Maaaaamaal  £x£l£iD£.  (with  Charles 
R.  Carmichael),  Technical  Report  CMPS-76-6-5,  Computer 
Science  Department,  University  of  Southwestern  Louisiana, 
Lafayette,  Louisiana,  May,  1976,  54p . 

Aa  SX££Xl£w  DBMS  B££££££hj.  Bx£l£Q  D££l£a^  Mon  i t or  ing  £ail 
Exaiuaiiaa.  (with  Sharad  K.  Agarwal),  Technical  Report 
CMPS— 76— 6— 6,  Computer  Science  Department,  University  of 
Southwestern  Louisiana,  Lafayette,  Louisiana,  June,  1976, 
77p  . 

Bzl£a£lBl£  lal££lfi£la£  £l  B£a£££ll2.£il  B£l£  B£££  M£a£££Q£al  £ad 
Sll££hl££.  Technical  Report  CMPS-76-6-7,  Computer  Science 
Department,  University  of  Southwestern  Louisiana,  Lafayette, 
Louisiana,  Sept,  1976,  33p. 

"The  User  Interface  to  Numeric  Data  Bases.,."  • Pr  oc . ASIS . 1976 

Annual  Meeting,  Vol.  13,  1976,  p.  70. 

££JC££a£llZ£ll  lai£lll££££  Affi£££  li££r£  , Inlormat  i on  fiX£i£B£  and 
fir&£hl££  Er£££££ia£,  Technical  Report  CMPS-76-6-8 , Computer 
Science  Department,  University  of  Southwestern  Louisiana, 
Lafayette,  Louisiana,  November,  1976,  19p. 

CQMEAKj.  a G£££r£ir;Elir££££  Efiifi  Compression  Package . (with  Boris 
R.  Bosch  and  Yeou  L.  Lin),  Technical  Report  CMPS-76-6-9, 
Computer  Science  Department,  University  of  Southwestern 
Louisiana,  Lafayette,  Louisiana,  December,  1976,  92p. 

"Information  .Specification  Processing  by  Use  of  Iterative 
Inference  From  a Meta— Base,"  (with  Thomas  Cousins  and  M.  H. 
McKinney),  Summary  in  E£££££di££fi  £l  ill£  Tenth  Hawa  i i 

lnl££&£ll£Q£l  C£al££££££  ££  Systems  Sc i ences . Honolulu, 

Hawaii,  January  5-7,  1977,  pp . 92-94;  Paper  in  Selected 

E£££££  In  M£a£££D£Bl  l£l££m£ll££  SX£l£ffl£ . l££lh  Hawai j 
inl£xn£ii£nai  C£nl£r££££  an  Sx£l£B£  Soiences  Supplement . pp . 
10-15 . 
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"Graphics  Support  for  Data  Base  Management  Systems,"  (with 
James  R.  Lee),  ErS£S.£dia£^  oX  Xhe  ISll  ACM  CfiBpuiaj:  Sc  i ence 
£oaXer£n££,  January  31  - February  2,  1977,  p.  27. 

"Optimizing  and  Evaluating  Data  Base  Structuring  on  MULTICS," 
(with  Glenn  A.  Shaffer  and  Sharad  K.  Agarwal),  Ex.££££dXll.fi.S. 
&1  Xh£  XE22  ACM  C£QcaX£r  C£X£a££  Conference . January  31  - 

February  2,  1977,  p.  23. 

MADAM : MulXX££  A£Cr£££h  Xa  DaXa  A£££££  aad  Management  Users 
CuXli£  > (with  Sharad  K.  Agarwal),  Technical  Report 
CMPS— 77— 6— 1,  Computer  Science  Department,  University  of 
Southwestern  Louisiana,  Lafayette,  Louisiana,  January,  1977, 
90p  . 

"Design  and  Implementation  Considerations  for  Monitoring  and 
Evaluating  Information  Systems,"  (with  Joseph  E.  Urban), 
Er££££iil&££  aX  ih£  IDib  Aa&u£l  Saulb£££l£j:n  B££la&£l  ACM 
CanX£r£n££.  April  18-20,.  1977,  pp.  356-370. 

"MADAM:  Multics  Approach  to  Data  Access  and  Management,"  (with 
Sharad  K.  Agarwal),  EJia£££liin££  aX  ih£  i£ih  A&&U&1 
Sauih£££l£i:n  Ea^ianai  ACM  CanXaxanaa,  April  18-20,  1977,  pp. 
182-195 . 


A Eaiaiianai  and  Haiw^rk  Database 
J . Simon  and  M.  H.  McKinney) , 
Computer  Science  Department, 
Louisiana,  Lafayette,  Louisiana 


Aaaaaa  Lanaaaaa, 
Technical  Report 
Un iversity  of 
May,  1977,  18p. 


(with  Donald 
CMPS-77-6-2 , 
Southwe  stern 


Eraiiffiinarx  Analxaaa  aX  MADAM  Y^raiana  1=&.  (with  Howard  g. 
Berg,  Sharad  K.  Agarwal  and  Joseph  E.  Urban),  Technical 
Report  CMPS— 77— 6—3 , Computer  Science  Department,  University 
of  Southwestern  Louisiana,  Lafayette,  Louisiana,  May,  1977, 

116p. 

A Maillaal  Baaarda  ExaXamj.  Eaundallaaa . Daalaa  aaii 

lB£l£D£aXaXlaa . (with  Steven  D.  Higgins  and  Glenn  A. 
Shaffer),  Technical  Report  CMPS— 77— 6— 4,  Computer  Science 
Department.,  -Un  i ver  s i ty  - o f Southwestern  Louisiana,  Lafayette, 
Louisiana,  May,  1977,  57p. 
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"Numeric  Data  Base  Systems:  Concepts  and  Capabilities," 

Coii££i.ioB  oi  S.1  ifae  Sixih  MidrXeax  oi  ibe 

Amexicfin  Socieiy  IBB  iBlfirBfiiian  Sc i ence . May  19-21,  1977, 

pp . 55-60 . 

MlilllElE  BbB£  SBBEBrl  Ibb  MAEAM  . (with  Glenn  A.  Shaffer), 

Technical  Report  CMPS— 77— 6— 5,  Computer  Science  Department, 
University  of  Southwestern  Louisiana,  Lafayette,  Louisiana, 
June,  1977,  70p. 

Ib£  DBMS  Sr££bl££  E££k£££.  (with  James  R.  Lee  and  Elie  T. 
Nassar),  Technical  Report  CMPS— 77— 6— 6,  Computer  Science 
Department,  University  of  Southwestern  Louisiana,  Lafayette, 
Louisiana,  June,  1977,  88p. 

"User  Interaction  Monitoring  as  a Multi-Level  Process,"  Pro c . 
ASIS.  1977  Annual  Meeting,  Vol.  14,  1977,  p.  63. 

"Information  Systems  for  Minicomputers  and  Networks:  A Course 

Proposal  for  Computer  Science  Curricula,"  (with  Glenn  A. 
Shaffer),  ££££££bla££  £l  lb£  £l£££&lb  Hfisall  lal££n£ll£a£l 
£aal£££a££  aa  SX£l.£B£  S£i.£aa££f  Honolulu,  Hawaii,  January 
5-6,  1978,  Volume  II,  pp . 180-208. 

Mulll£l£  B£l£  B£££  SB£££ri  l£X  MADAM : Eb£££  11.  (with  Glenn  A. 
Shaffer  and  George  A.  Albracht),  Te  chn i c a 1 Repo  r t 
CMPS— 78— 6—1,  Computer  Science  Department,  University  of 
Southwestern  Louisiana,  Lafayette,  Louisiana,  January,  1978, 
69p  . 

Era££££ii  B££££££b  Abbr£££la£  lb£  lal£r£all£l  BErlzallaa  al 
Balrlazal  Baffiaallaa  Bllllalaa  a Balallaaal  Xlas  al  a 
M£la=Baa£ . (with  Thomas  R.  Cousins),  Technical  Report 
CMPS— 78— 8—2 , Computer  Science  Department,  University  of 
Southwestern  Louisiana,  Lafayette,  Louisiana,  February,  1978, 
37p  . 

"Techniques  for  Evaluating  Computer-Based  Systems  for  Numerical 
Data  Management,"  (with  Joseph  E.  Urban),  Proceedings  o f ib£ 
Blzlb  Inlaraallaaal  £DBAIA  hanlaranaa . Santa  Fiavia,  Sicily, 
May  22-25,, 1978,  pp . 371-375. 


I DBMS .NASA/RECON-2  | 


45 


I PROPOSAL  I 


I N A S A I 


I 01/16/84  I 


Wayne  D.  Dominick  (Continued) 


03/83 


ExoiiJ.£  Mo4£i.i.i.fi£  Xsr  S c,is.ac,£ 

XnXojiB£.XXofi  Sj£i£BS.J.  A B£££ilX  £fi  C£V£Xo£BeaX  (ll  fi 

Gea£X£ll2.£d  EyaiuaiioB  Meiho dolo^y  io  Silldl  Ha£X  InlexBBlloB , 
(with  Lorraine  Borman),  Final  Report,  NSF  Grant  No. 
DSI76-19481,  June,  1978,  258p. 

A££Xi.£fiXX£a  £l  & G£n£Xfiiii£d  Ev&Xufiti  on  Methodo  logy  for 
Ansiiiinx  Usxr  Inifirfixiianx  wiih  ids  MADAM  System  &i  the 
iZnizxrfiiil  s.1  SaaihEe^i^m  Louisiana,  (with  Joseph  E.  Urban), 
Technical  Report  CMPS-78-6-3,  Computer  Science  Department, 
University  of  Southwestern  Louisiana,  Lafayette,  Louisiana, 
September,  1978,  347p. 

Hiararfiliiaai  IdxxaaruA  Eraxixxiax  lax  MADAM.  (with  Roger  L. 
Patton),  Technical  Report  CMPS— 78— 6— 4,  Computer  Science 
Department,  University  of  Southwestern  Louisiana,  Lafayette, 
Louisiana,  September,  1978,  41p. 

lll£  USE  DBME  Exai££i.  Technical  Report  CMPS-78-6-5,  Computer 
Science  Department,  University  of  Southwestern  Louisiana, 
Lafayette,  Louisiana,  September,  1978,  140p. 

"The  Management  of  Data  Bases  of  Data  Bases,"  (with  Thomas  R. 
Cousins),  Exfl£££dinx£  fil  ill£  Ifilfi  Annual  Meeting  ih£ 
Affi£Xi£fin  fi££i£lx  l£X  Inloxsation  Sc i ence . Vol.  15,  November 
13-17,  1978,  pp.  75-78. 

"Interaction  Monitoring  Considerations  Within  Network— Based 
Information  Systems,"  (with  W.  David  Penniman) , North 
AB£Xi£&n  M£iwoiikinx  ££ii£ci£d  Efi££X£.  Eixhih  Mid:rl££X  Meet  ing 
£l  ih£  AB£Xi£fin  S££i£ix  l£X  InXoxma  t Ion  Sc  i ence . Banff, 
Alberta,  Canada,  May  16-19,  1979,  p.  F4 . 

I1X£  Unii£X£iix  £l  S£UlliE££i£xn  L£iii£iAB£  H5E/B1AS=DBMS  fi£xkini 
EfiC£X  B£Xl££.  (Editor  and  Primary  Author),  Collection  of 
Reports  to  the- National-Science  Foundation  by  the  University 
of  Southwestern  Louisiana  under  NSF  Grant  No.  SER77-06835, 
1978-1979 . 

Ih£  D££lx&.i.  M£Qll.£Xln£  ££d  E£Xl£XB&B££  ExaluaLlon  £l  - MADAM 
XMu111££  Afi£X£££ll  l£  Dhlh  A£££££  find  Management). . (with 
Shared  K.  Agarwal),  Technical  Report  CMPS-79-6-1 , Computer 
Science  Department,  University  of  Southwestern  Louisiana, 
Lafayette,  Louisiana,  August,  1979,  214p. 
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A ErfiE£S£d  Mofliisrini  EfiEiiiix  l&r  ibe  Q£L£  On-Linp  Syst^p. 
Research  Journal  No.  96,  Research  Department,  OCLC,  Inc., 
Columbus,  Ohio,  August  9,  1979,  98p,  (OCLC  internal 

proprietary  document). 

"Automated  Monitoring  to  Support  the  Analysis  and  Evaluation 
Information  Systems,"  (with  W.  David  Penniman) , Proceedings 
fll  ili£  fi££End  Q&b1£L£U£.£  an  Inlormation  Storage 

find  BfiirifiXfii.  ACM  SlfilB  EQBilM.  Vo  1.  XIV,  No.  2,  September 
27-28,  1979,  pp . 2-9. 

Ihfi  Dfifiinn^  iBElfimfinifiiisn.^  find  Ufifixfi  e1  BEAE  (Bibl  iographic 
Efilfi  AnfilXfilfi  EfiEkfififil,  (with  George  S.  Fissel,  Jr.  and 
Christie  M.  Davis),  Technical  Report  CMPS-79-6-2,  Computer 
Science  Department,  University  of  Southwestern  Louisiana, 
Lafayette,  Louisiana,  October,  1979,  206p. 

Ihfi  Efifilfin . iBElfiBfinlfillEn  > find  UfifiXfi  eX  nn  Automat i c Data 
YfiiidfiilEn  EfifiliiiX  l&r  MAEAM  Monitor  Records . (with  Sandeep 
V.  Hemmady  and  Christie  D.  Michelsen),  Technical  Report 
CMPS— 79— 6— 3 , Computer  Science  Department,  University  of 
Southwestern  Lou i s i ana , Laf aye 1 1 e , Louisiana,  November,  1979, 
55p. 

EjcflEfififid  Bfifififirfih  Addrfififiinn  ili£  CbXfinilXfi  Evaluat  ion  of 
IS&B/EBMS  SifiifiBfi  Ufiinfi  SflXiHfirfi  Enfiinfifirinn  ErinniEififi . 
(with  Christie  D.  Michelsen),  Technical  Report  CMPS-79-6-4, 
Computer  Science  Department,  University  of  Southwestern 
Louisiana,  Lafayette,  Louisiana,  December,  1979,  Revision  1, 
April,  1980,  77p. 

An  Qxfirxifiif  eX  & ErsEEfiEd  MEniXfixinx  Facility  for  the 
Lfi£X£=BEfil£^  B£lfiE£B=Bfifi£d  ECLC  Qn-Llnfi  System.  (with  W. 
David  Penniman  and  James  E.  Rush),  Research  Report  No. 
OCLC/OPR/RR— 80/1 , Research  Department,  Office  of  Planning  and 
Research,  OCLC,  Inc.,  Columbus,  Ohio,  January  23,  1980,  22p. 

"The  Application  of  Software  Engineering  Principles  to  Existing 
Information  Storage  and  Retrieval  Systems,"  (with  Christie  M. 
Davis),  presented  at  the  1980  -Annual  Meet  ing  of-  the  Louisiana 
Academy  of  Sciences,  Hammond,  La.,  February  8-9,  1980. 
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"An  Automated  Monitor  Data  Validation  Facility  for  the  MADAM 
Information  Storage  and  Retrieval  System,"  (with  Sandeep  V. 
Hemmady  and  Christie  M.  Davis),,  presented  at  the  1980  Annual 
Meeting  of  the  Louisiana  Academy  of  Sciences,  Hammond,  La. , 
February  8-9,  1980. 

"Performance  Measurement  and  Evaluation  of  the  MADAM 
Information  Storage  and  Retrieval  System,"  (with  Peggy  A. 
Nance  and  Christie  M.  Davis),  presented  at  the  1980  Annual 
Meeting  of  the  Louisiana  Academy  of  Sciences,  Hammond,  La. , 
February  8-9,  1980. 

"The  Use  of  Software  Engineering  Techniques  to  Support 
Information  System  Evaluation,"  (with  Christie  M.  Davis), 

ACM  Cflapuifir  Ssifinss  , 

February  12-14,  1980,  p.  43. 

"A  Methodology  for  the  Objective  Evaluation  of  the  User/System 
Interfaces  of  the  MADAM  System  Using  Software  Engineering 
Principles,"  (with  Christie  D.  Michelsen  and  Joseph  E. 
Urban)  , Erfi£££din££  Hi  ill£  Ifilh  Annual  Snulheastern  Reg i ona  1 
ACM  Cunl£££n££.  Tallahassee,  FI.,  March  24-26,  1980,  ‘ pp . 

103-109. 

"Monitoring  and  Evaluation  of  On-Line  Information  System 

Usage,"  (with  W.  David  Penniman) , Jni ormat i on  Process ing  and 
Manaaamani.  Voi.  16,  No.  i,  1980,  pp.  17-35. 

Xh£  C£MS  Slallallaal  Analxala  Eaakaaa  Inr  MACAM.  (with  Peggy  a. 
Nance  and  Christie  D.  Michelsen),  Technical  Report 
CMPS— 80— 6— 2,  Computer  Science  Department,  University  of 

Southwestern  Louisiana,  Lafayette,  Louisiana,  May,  1980, 
141p. 

Ib£  Caaian  and  iDnlamanlallun  s.1  Ida  MACAM  Cala  Saaa 

Badal.lnll.lnn  Sudaxalam.  (with  Mohtashim  Naveed  and  Mohammad 
U.  Farooq),  Technical  Report  CMPS— 80— 6— 3,  Computer  Science 
Department,  University  of  Southwestern  Louisiana,  Lafayette, 
Louisiana,  May,  1980,  89p. 

"The  Application  of  Monitor  Data  Analysis  Techniques  to  Audit 
Trail  Data  From  an  On-Line  System,"  (with  W.  David  Penniman), 
Exnaaadlnaa  nl  Ida  Hlnld  Mld=Xaa£  Maallna  nl  Ida  Amer i can 
Snnlalx  Inr  Inlnrmalinn  Saianaa.  Pittsburgh,  Pa.,  May  15-17, 
1980,  (to  appear). 
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"Applying  Available  Evaluation  Functions  to  Information 
Programs  and  Services  — Combining  Theoretical  and  Pragmatic 
Approaches."  (with  W.  David  Penniman) , Proceedings  aX  the 
XSrd  Aaauhl  M&&Llue.  s.L  ihs.  Am£rl£aa  Sa£l£lx  l££  Iniotroat  i on 
S£X£a££ . Anaheim,  Ca.,  October  5-10,  1980,  (to  appear). 

"Information  System  Monitoring  and  Analysis  to  Support  the 
Evaluation  of  Computerized  Access  to  On-Line  Data  Bases:  Part 

I.  Monitoring,"  (with  W.  David  Penniman),  presented  at  the 

7th  International  CODATA  Conference,  Kyoto,  Japan,  October 
8-11,  1980.  Abstract  in  lai£iiafiiiflaal  CQEAIA  £fial£X£a££ 

Ab£l£fi£i£.  £2DAIA  Eaii£ila  No.  37,  July,  1980,  p.  45,  (full 
paper  to  appear). 

"Information  System  Monitoring  and  Analysis  to  Support  the 
-Evaluation  of  Computerized  Access  to  On-Line  Data  Bases:  Part 

II.  Analysis,"  (with  W.  David  Penniman),  presented  at  the  7th 
International  CODATA  Conference,  Kyoto,  Japan,  October  8-11, 
1980.  Abstract  in  lih  lnl£Xn£iifinfil  £QEA1A  C£nl£X£n££ 
Ab£iX££i£.  CQDAIA  Bulixiin  No.  37,  July,  1980,  p.  45,  (full 
paper  to  appear). 

MADAM  U££Xl£  fiuld£J.  IxIUDX  1 = MADAM  D££X£  Manual . (with 

Christie  D.  Michelsen  and  Mohammad  U.  Farooq) , Technical 
Report  CMPS-80-6— 4,  Computer  Science  Department,  University 
of  Southwestern  Louisiana,  Lafayette,  Louisiana,  December, 

1980,  Revision  1,  January,  1982,  106p. 

lh£  D£V£io£Q£nX  M£&£X£ffi£nl=Dxl£&l£d  M£n£X£B£ni  laX£XDfill£n 
Sy s t eros . (with  Yu-Ping  Chen),  Technical  Report  CMPS-81-6-1, 
Computer  Science  Department,  University  of  Southwestern 
Louisiana,  Lafayette,  Louisiana,  March,  1981,  33p. 

Ih£  D££lxn  and  lfflel£D£nl£ll£n  s.1  Maxxx  Ex£££££ln£  l£X  lh£  MADAM 

System.  (with  William  M.  Edwards),  Technical  Report 

CMPS-8 1-6-2  Comput  er-  Science  Department,  University  of- 

Southwestern  Louisiana,  Lafayette,  Louisiana,  November,  1961, 
72p. 

Ib£  MADAM  E£lXs£X£  MualXfiXJ.  Maallax  Bxxaxd  Slxu£lux£.  (with 
Mohammad  U.  Farooq  and  Christie  D.  Michelsen),  Technical 
Report  CMPS— 81— 6— 4,  Computer  Science  Department,  University 
of  Southwestern  Louisiana,  Lafayette,  Louisiana,  December, 

1981,  38p. 
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Ihs.  Defiiin  find  MADAM  System 

A4mlBl£l££llBB  DuDsxaIbd.  (with  Sandeep  V.  Hemmady  and 
Mohammad  U.  Farooq) . Technical  Report  CMPS-81-6-5,  Computer 
Science  Department,  University  of  Southwestern  Louisiana, 
Lafayette,  Louisiana,  December,  1981,  55p. 

"Generalized  Database  Management  System  Support  for  Numeric 
Database  Environments,"  (with  Peggy  G.  Weathers),  Dreie 1 
Lihrfiry  Qaatifinlx  Isbub  s.n  Humeri  c Databases . Vol. 

18,  Nos.  3 & 4,  Summer-Fall,  1982,  pp . 177-188. 

"The  Critical  Role  of  User  Education  Within  the  Educational 
Information  Systems  Planning  Process,"  (with  Peggy  G. 

Weathers),  presented  at  the  Twentieth  Annual  Convention  of 
the  Association  for  Educational  Data  Systems,  Orlando, 
Florida,  May  10—14,  1982,  (to  appear). 

"On  Developing  Management— Or i ented  Management  Information 

Systems,"  (with  Yu-Ping  Chen),  Campul er  Research  J ournal  - 
luaiififiPiiPiia  oi  lACS  Xlaisan  Asaapiaiian  al  Computer 

Salanaal.  Taiwan,  Republic  of  China,  Vol.  11,  No.  1,  January, 
1982,  pp.  53-74. 

Inlaraal  Slraaiara  al  a Caopiiiar  Aidad  fill  Balinari  Production 
Sahadullaa  Ssalan,  (with  Yu— Ping  Chen),  Technical  Report 
CMPS— 82— 6— 2 , Computer  Science  Department,  University  of 
Southwestern  Louisiana,  Lafayette,  Louisiana,  October,  1982, 
75p. 

"An  Information  System  Performance  Measurement  and  Evaluation 
Environment",  (with  Christie  D.  Michelsen),  accepted  for 
presentation  at  the  12th  Mid-Year  Meeting  of  the  American 
Society  for  Information  Science,  to  be  held  in  Lexington, 
Kentucky,  May  22-25,  1983,  (to  appear). 

"Controlled  Information  System  Usage  -Experiments  to  Support 
User/System  Evaluations",  (with  Christie  D.  Michelsen), 
accepted  for  presentation  at  the  12th  Mid-Year  Meeting  of  the 
American  Society  for  Information  Science,  to  be  held  in 
Lexington ,. -Kentucky t May  22-25,  1983,  (to  appear). 
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**DBMS  Design  Concepts,*'  Keynote  Address  presented  at  the  ACM 
M i d-Sou t hea  s t Chap t er  Meeting,  Chatt  anooga , Tenn . , July 

22-23 , 1976 . 

Panelist.  "Bibliographic  and  Numeric  Data  Bases  — A Comparison 
of  the  Online  Interfaces,"  Special  Interest  Group  on  User 
On-Line  Interaction  and  Special  Interest  Group  on  Numeric 
Data  Bases,  ASIS,  1976  Annual  Meeting,  San  Francisco,  Ca., 
October  5-9 , 1976 . 

Invited  Participant,  Executive  Seminar  — Computer  Usage  in 
Management,  Sperry  Univac  Corporation,  Miami,  FI..  October 
17-19 , 1976 . 

Session  Co-Chairman  (with  Ronald  R.  Dueltgen)  and  Panelist, 
"Scientific  Applications  of  Numeric  Data  Bases."  Joint 
Session  of  the  Special  Interest  Group  on  Biological  and 
Chemical  Information  Systems  and  the  Special  Interest  Group 
on  Numeric  Data  Bases,  Sixth  Mid-Year  Meeting  of  the  American 
Society  for  Information  Science,  Syracuse,  New  York,  May 
19-21,  1977. 

Pane  list,  "Design  Considerations  for  Info  rma t ion  Retrieval 
Systems,"  Sixth  Mid-Year  Meeting  of  the  American  Society  for 
Information  Science,  Syracuse,  New  York,  May  19-21,  1977. 

Panelist,  "Online  User  Monitoring  to  Improve  User  Interaction," 
Special  Interest  Group  on  User  On-Line  Interaction.  1977 
Annua  1 Meeting  of  the  Ame  r i can  Society  for  Info  rmat ion 
Science,  Chicago,  Illinois,  September  26  - October  1,  1977. 

Panelist,  "Minicomputer  Applications:  Where  Are  We  Heading?" 
Eleventh  Hawaii  International  Conference  on  Systems  Sciences, 
Hono lulu , Hawa i i , J anuary  5-6 ,1978. 

Technical  Program  Chairman,  American  Society  for  Information 
Science,  Special  Interest  Group  on  Numeric  Data  Bases,  1978 
AS  I S.  M i d— Year  Me e t ing , May  22—24,  1978,  Houston,  -Texas  and 

1978  ASIS  Annual  Meeting,  November  13-17,  1978,  New  York,  New 

York . 
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Session  Chairman,  "Techniques  to  Support  the  Management  and 
Evaluation  of  Numeric  Information  Systems,"  Special  Interest 
Group  on  Numeric  Data  Bases,  Seventh  Mid-Year  Meeting  of  the 
American  Society  for  Information  Science,  Houston,  Texas,  May 
22-24,  1978. 

First  Invited  Speaker,  OCLC  Distinguished  Seminar  Series, 
Research  Department,  OCLC,  Inc.,  Columbus,  Ohio,  June,  1978. 

Session  Chairman,  "Current  Applications  and  Future  Trends  in 
Numeric  Data  Bases  and  Systems,"  Special  Interest  Group  on 
Numeric  Data  Bases,  1978  Annual  Meeting  of  the  American 
Society  for  Information  Science,  New  York,  New  York,  November 
13-17,  1978. 

Keynote  Speaker,  "Computer  Assisted  Instruction  Workshop," 

National  Science  Foundation,  Minority  Institutions  Science 
Improvement  Program,  Southern  University,  Baton  Rouge, 

Louisiana,  June  2,  1980. 

Keynote  Speaker,  "Computer  Assisted  Instruction  Workshop," 

- National  Science  Foundation,  Minority  Institutions  Science 
Improvement  Program,  Southern  University,  Baton  Rouge, 

Louisiana,  June  8,  1981. 

Keynote  Speaker,  Southern  University  Science  Research  Council 
Annual  Meeting,  Southern  University,  Baton  Rouge,  Louisiana, 
April  13,  1983. 


Recipient,  Outstanding  Young  Men  of  America  Award,  1977. 

Listed  in  Who’s  Who  in  the  South  and  Southwest,  1978, 
1980 . 1981  , 1982 . - 

Listed  in  Personalities  of  the  South,  1978-79,  1980-81. 

Listed  in  Pe  r s ona  1-i  t i e s o f Amer  i ca  , 1 978-79  . 

Listed  in  Notable  Americans,  1978-79. 

Listed  in  Book  of  Honor,  1969-79. 
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Listed  in  American  Men  and  Women  of  Science,  1979,  1982. 

Listed  in  Men  of  Achievement,  1979—80. 

Listed  in  the  Dictionary  of  International  Biography,  1979-80. 

Listed  in  the  American  Business  Registry,  the  American 
Educational  Registry,  and  the  American  Scientific  Registry, 
1980  . 


UaiZ£rsii2z:E£i&i£d_Elind£<i_fir&nia/£flnirA£ifi / Partial  List  ) 

"Service  to  Provide  Information  Storage  and  Retrieval  for 
Dissemination  of  Information  on  Industrialized  Buildings" 

U.  S.  Army  Corps  of  Engineers 

Construction  Engineering  Research  Laboratory 

Champaign,  Illinois 

Contract  Number:  DACA88-74-C-0058 

Principal  Investigator  for  Northwestern  Univ.,  Evanston,  IL. 
Funding:  $15,000. 

Dates:  June  26,  1974  - June  25,  1976. 

"Interaction  with  Federal  Data  Banks" 

Department  of  Conservation 
Natural  Resources  & Energy  Division 
State  of  Louisiana 
Baton  Rouge,  Louisiana 

Energy  Management  Program  #NRE-EM-75-l 1 
Co— Principal  Investigator 
Funding : $32,709. 

Dates:  December  1,  1975  - March  31,  1977. 

"Information  Storage  and  Retrieval  System  Evaluations" 

U.  S.  Army  Corps  of  Engineers 
. ...USAE  Waterways  Experiment  Station 
Vicksburg,  Mississippi 
Contract  Number:  DACW39-76-M-4232 
Principal  Investigator 
Funding : $3 , 000 . 

Dates:  April  1,  1976  - April  30,  1976. 
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"Profile  Evaluation,  Research  and  Modeling  for  Science 
Info  rma t ion  Sy s t ems " 

Division  of  Science  Information 

National  Science  Foundation,  Washington,  DC. 

Grant  Number:  DSI76-19481 

Principal  Investigator  for  The  University  of  Southwestern 
Louisiana  under  subcontract  to  Northwestern  University 
Funding:  Total:  $53,000.  USL:  $20,284. 

Dates:  September  1,  1976  - June  30,  1978. 


"Research  Initiation  and  Support  (areas  of  microcomputer 
systems,  distributed  networks  and  data  base  management 
sy s t ems ) " 

Division  of  Science  Education  Resources  Improvement 
National  Science  Foundation,  Washington,  DC. 

Grant  Number:  SER77-06835 
Invest i gator 
Funding : $178 , 700  . 

Dates:  May  1,  1977  - July  31,  1980. 

Eighth  World  Computer  Congress  - IFIP  80  Travel  Grant 
National  Science  Foundation,  Washington,  DC  and 
American  Federation  of  Information  Processing  Societies, 
Funding : $1 , 000 . 

Dates:  October  6—9,  1980  (Tokyo,  Japan). 


Inc  . 


"Advanced  Institutional  Development  Program" 

U.  S.  Department  of  Health,  Education  and  Welfare 
Washington,  DC. 

Grant  Number:  G007602486 

Southern  University,  Baton  Rouge,  Louisiana 
Funding : $3,000,000. 

Dates:  January  1,  1977 — June  30,  1981. 

"Management  Information  System  Consortium" 

Elementary  and  Secondary  Education  Act,  Title  IV,  Part  C 
Department  of  Educat  i on  , St  at  e o f Loui  s i-ana  , 

Baton  Rouge,  Louisiana 
Project  Number:  28-791096-0 

Tangipahoa  Parish  School  Board,  Amite,  Louisiana 
Funding:  $149,200. 

Dates:  July  1,  1978  - June  30,  1979. 
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"Minority  Institutions  Science  Improvement  Program: 
Individualized  Institutional  Project" 

Division  of  Science  Education  Resources  Improvement- 
National  Science  Foundation,  Washington,  DC. 

Grant  Number:  SER-7907407 

College  of  Sciences,  Southern  University, 

Baton  Rouge,  Louisiana 
Funding:  $265,064. 

Dates:  August  1,  1979  - July  31,  1982. 


^ . 


I DBMS .NASA/RECON-2  | 


55 


I PROPOSAL  I 


I N A S A I 


I 01/16/84  I 


Resume 


Leroy  Roquemore 
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Southern  University 
Department  of  Computer  Science 
P.  0.  Box  10005 
Baton  Rouge,  LA  70813 
(504)  771-2060 


££rsaaal_SlAll£ll££ 

United  States  Citizen 
Birthdate  4 April  1935 
Birthplace:  Columbia,  Louisiana 


Ea^lllan 

Associate  Professor  and  Chairman,  Department  of  Computer 
Science,  Southern  University,  Baton  Rouge,  LA,  1973-present. 

Comput er— As s i s t ed  Instruction 
Modelling  and  Simulation 

Software  Monitoring  and  System  Performance  Evaluation 
Data  Base  Management  System  Design 


£iiU££ll£fi 

B.S.,  Mathematics,  Southern  University,  1957. 

M.S.,  Mathematics,  Louisiana  State  University,  1963. 

Ph.D.,  Computer  Science,  University  of  Southwestern  Louisiana, 
(Expected  August,  1983). 


filtl££_£ll£l£££l£n£l_CZC££l£ll££ 

Co-Principal  Investigator,  "Minority  Institutions  Science 
Improvement  Program,"  National  Science  Foundation,  Grant 
Number:  SER-7907407,  College  of  Sciences,  Southern 

University,  Baton  Rouge,  Louisiana,  Funding:  $265,064,  August 
1 , 1979  - July  31 , 1983 . 
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Principal  Investigator,  "Information  Systems  Technology  Study," 
National  Aeronautics  and  Space  Administration,  Contract  No. 
NASW-33,  1981-1982. 

Review  Panelist,  The  National  Educational  Computing  Conference, 
1980-present . 

College  of  Sciences  Research  Council,  Southern  University, 
1980-present . 

Review  Panelist,  Comprehensive  Assistance  to  Undergraduate 
Science  Education  (CAUSE),  National  Science  Foundation, 
1979-present . 

Member,  Systems  Science  Graduate  Faculty,  Louisiana  State 
University,  1979-present. 

National  Science  Foundation  Fellow,  Louisiana  State  University, 
1962-1963 . 

National  Science  Foundation  Fellow,  University  of  Kansas,  1961. 

Graduate  Assistant,  University  of  Southwestern  Louisiana, 
1973-1974. 


Associate  Research  Engineer,  The  Boeing  Company,  New  Orleans, 
Louisiana,  1963-1966. 

Software  Engineer,  Western  Electric,  North  Andover, 
Massachusetts,  1967. 


Project  Director,  Raytheon  Data  Systems  Programmable  Terminal 
System  1200  Software  Development  Project,  Southern 
University,  Baton  Rouge,  Louisiana,  1978-1981. 
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Bradley,  H. , Roquemore, 
Instruction  on  the  Qua 
Courses,**  Research  Paper 
1983  . 


L.  "Effects  of  Computer-Assisted 
ity  of  Education  in  Selected  Science 
The  Louisiana  Academy  of  Sciences, 


Bartley,  !»,.  Ro quemo re,  L . "A  Doub le  Distribution  Func t ion  for 
a Relational  Data  Base,"  Research  Paper,  The  Louisiana 
Academy  of  Sciences,  1979. 


Roquemore,  L.,  Williard,  M. 
Study,"  Final  Report, 
Admin istration,  Washington, 
Dec  ember , 1982. 


**  Inf  ormat  ion  Sy  s t ems  Techno  logy 
National  Aeronautics  and  Space 
D.C.,  Contract  Number:  NASW-33, 


Roquemore,  L.  ''Raytheon  Data  Systems  Programmable  Terminal 
System  1200  Software  Development  Project,"  Final  Report, 
Raytheon  Data  Systems  Company,  Norwood,  Massachusetts,  1981. 


Ro  quemo  re,  L . " An  Invitation  to  Bid  for  an  Educ  a t i ona 1 

Computing  System,"  Southern  University,  Baton  Rouge, 
Loui s iana , 1979 . 

Morrison,  J.  W.,  Prestage,  J.  J.,  and  Roquemore,  L.  CilBPliifir 
lime^Shfirin^  E^&Aihi-iilX  Sillfix.  Department  of  H.E.W.  (USOE), 
Washington,  D.C.,  1971. 

"Calculation  of  a Theoretical  Thrust  Coefficient,"  Technical 
Paper,  The  Boe ing  Company , New  Orleans,  Louisiana,  1963. 

"Trajectory  Study  of  Particles  from  the  Exhaust  Plume  of  a 
Rocket  Engine  Which  Impinge  Upon  and  Cause  Heating  Problems 
on  a Launch  Pad,"  Technical  Paper,  The  Boeing  Company,  New 
Orleans,  Louisiana,  1963. 
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"Problems  Caused  by  Cavitation  of  a Fluid  at  the  Inlet  Ports  of 
Turbo-Pumps,"  Technical  Paper,  The  Boeing  Company,  New 
Orleans,  Louisiana,  1963. 

"Simulation  of  Stage  Separation  and  Retro— Rocket  Performance  on 
a Space  Vehicle,"  Technical  Paper,  The  Boeing  Company, 
1963-65 . 

"Heat  Stratification  Across  the  Exhaust  Plume  from  Combustion 
Chamber  of  a Rocket  Engine  During  Steady-State  Performance," 
Technical  Paper,  The  Boeing  Company.  1963-65. 

"Simulation  of  Ignition,  Start,  Hold-Down,  Lift-off,  and 
Steady-State  Performance  of  a Space  Vehicle,"  Technical 
Paper,  The  Boeing  Company,  1963—65. 

"The  Feasibility  of  Minuteman  Rocket  Strap— on  to  Increase 
Thrust  and  Specific  Impulse  for  the  Saturn  Booster," 
Technical  Paper,  The  Boeing  Company,  1963—65. 

"A  Study  of  the  Characteristics  of  a Film  of  Liquid  Oxygen  Left 
in  a Tank  which  was  Depleted  by  Turbo-Pumps,"  Technical" 
Paper,  The  Boeing  Company,  1963-1965. 
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STANDARDIZED  COURSE  MATERIAL  DOCUMENTATION 


TEMPLATES 


STANDARDIZED  COURSE  SYLLABUS  TEMPLATE 


COURSE  NAME: 


Identification  of  the  name  of  the  course. 


OBJECTIVES : 


Spec i f i cat i on 
course  in 
expe r i enc  e t o 
cour  s e . 


of  the  pr imar y obj  ect  ives 
t e ms  of  the  information 
be  impart  ed  to  students 


of  the 
and/or 
o f the 


PREREQUISITES:  Specification  of  the  basic  prerequisites  expected 
of  prospective  students  of  the  course. 


SCHEDULING:  Specification  of  the  duration  of  the  course  in 

terms  of  the  number  and  type  of  instructor/student 
contact  hours  and/or  laboratory  hours. 

COURSE  FORMAT:  Specification  of  the  types  of  instructional 

f o rma t s to  be  emp loyed  in  the  course. 


REQUIREMENTS:  Specification  of  the  requirements  of  the  students 

in  the  course  in  terms  of  homework  assignments, 
hands-on  RECON  usage  assignments,  examinations, 

and  so  on ..  For  graded  courses,  percentage  of  final 

grade  associated  with  each  requir ement  is  also 
spec i f i ed . 


COURSE  OVERVIEW:  Detailed  specification  of  the  major  topics  to 

be  addressed  within  the  course;  breakdown  of  major 
topical  areas  into  specific  component  subjects  to 
be  addressed;  and  specification  of  instructional 
duration  for  each  major  topical  area. 
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REQUIRED  READINGS:  Specification  of  alternative  required  reading 

material  and/or  text(s)  for  the  course. 


POTENTIALLY  REQUIRED  READINGS:  Specification  of  the  types  of 

reading  material  that  may  potentially  be  required 
within  the  course,  depending  upon  instructor 
prerogative  and/or  availability  of  system  (RECON) 
and  data  base  documentation, 

REFERENCE  BIBLIOGRAPHY:  Identification  of  the  reference 

bibliography  provided  to  support  the  course. 


STANDARDIZED  LESSON  PLAN  TEMPLATE 


COURSE  NAME:  Identification  of  the  name  of  the  course. 


LESSON  NAME:  Identification  of  the  name  of  the  lesson. 


LESSON  OBJECTIVE:  Identification  of  the  primary  objectives  of 

the  lesson  in  terms  of  the  information  to  be 
presented  to  the  student  within  this  lesson. 


MEDIA  AND  EQUIPMENT:  Identification  of  the  presentation  media 

and  equipment  to  be  used  as  part  of  presenting 
this  lesson. 


REFERENCES:  Identification  of  the  specific  reference  material 

to  be  employed  in  the  preparation  for,  and 
presentation  of  this  lesson. 


METHOD  OF  PRESENTATION:  Identification  of  the  specific  method(s) 

of  instruction  to  be  employed  in  the  presentation 
of  thi s 1 esson . 
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LENGTH  OF  LESSON:  Identification  of  the  number  of  instructional 

hours  to  be  devoted  to  this  lesson. 


LEARNING  OBJECTIVES:  Identification  of  the  specific  learning 
objectives  associated  with  this  lesson  in  terms  of 
the  specific  capabilities  that  the  student  will 
gain  as  a result  of  having  taken  this  lesson. 


PLAN  FOR  CONDUCTING  THE  LESSON:  Identification  of  the  major 

topical  areas  to  be  covered  within  this  lesson; 
the  order  of  their  presentation;  and  the  amount  of 
time  to  be  devoted  to  each  such  area. 


ASSIGNMENTS : 


Identification  of  the  specific 
assignments  associated  with  this 
assignments  may  include  reading 
homework  assignments,  and/or 
assignments,  as  appropriate. 


out-o  f-c lass 
lesson.  Such 
ass ignment  s . 
RECON  usage 


STANDARDIZED  HOMEWORK  ASSIGNMENTS  TEMPLATE 

LEARNING  OBJECTIVES:  Textual  description  of  the  motivation  for 

performing  this  homework  assignment  and  the 
learning  objectives  associated  with  the 
as  s i gnment . 

ASSIGNED  TASKS:  Identification  of  the  specific  tasks  to  be 

performed  as  part  of  this  homework  assignment. 
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ASSIGNED 


ANSWERS : 


LEARNING 


ASSIGNED 


ASSIGNED 


ANSWERS : 


STANDARDIZED  HOMEWORK  ASSIGNMENTS  ANSWER  KEY 
TEMPLATE 


TASKS:  Reiteration  of  the  specific  tasks  to  be 

performed  as  part  of  this  homework  assignment. 

Statement  of  correct  answers  to  each  assigned 
task/quest i on . 


STANDARDIZED  USAGE  ASSIGNMENTS  TEMPLATE 


OBJECTIVES:  Textual  description  of  the  motivation  for 

performing  this  RECON  usage  assignment  and  the 
learning  objectives  associated  with  the 
as  s i gnment . 


TASKS:  Identification  of  the  specific  tasks  to  be 

performed  using  RECON  as  part  of  this  usage 
as  s i gnment . 


STANDARDIZED  USAGE  ASSIGNMENTS  ANSWER  KEY  TEMPLATE 


TASKS : Re i terat ion  of  the  specific  tasks  to  be  perfomed 

using  RECON  as  part  of  this  usage  assignment. 


For  each  assigned  task,  the  full  text  of  a series 
of  user/system  RECON  interactions  which  results  in 
the  correct  answer(s)  to  that  task. 
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STANDARDIZED  EXAMINATION  TEMPLATE 


BASIC  CONTROL  DATA: 

Identific 

data. 

e . g . , t 

etc.). 

format  o 

book . 

etc.),  du 

LESSON  IDENTIFICATION 

I dent  i 

r e 1 evant  to  e 

ensure 

coverage 

1 essons  compr i s 

ation  of  basic  examination  control 
ype  of  examination  (midterm,  final, 
f examination  (open  book.  closed 
ration  of  exami na t ion.  etc. 

fication  of  the  course  lesson(s) 
ach  question  on  the  examination,  to 
of  the  examination  across  all 
ing  the  course . 


QUESTIONS : 


S t a t ement  of  the  que  s t i ons  compr ising  the 
examinat i on . 


STANDARDIZED  EXAMINATION  ANSWER  KEY  TEMPLATE 


BASIC  CONTROL  DATA:  Identification  of  basic  examination  control 

data  (as  above) . 


QUESTIONS:  Reiteration  of  the  questions  comprising  the 

examinat i on . 


ANSWERS ; 


S t at  ement  o f 


correct  answers  to  each  question. 


VISUALS  OBJECTIVES  / GUIDELINES 

(1)  The  collection  of  course  visuals  will  represent  a complete 
and  comprehensive  presentation  of  the  topical  areas  defined 
within  the  course  syl labus . 


I DBMS . NASA/RECON-2  | 


64 


I PROPOSAL  I 


I N A S A I 


I 01/16/84  I 


The  collection  of  course  visuals  will  provide  the  framework 
whereby  a qualified  instructor  can  effectively  teach  the 
course  utilizing  the  associated  course  syllabus,  lesson 
plans,  etc. 


The  collection  of  course  visuals  will  provide  the 
information  necessary  to  enable  a conscientious  student  to 
obtain  a c o 1 1 eg e— 1 eve  1 understanding  of  the  course  material 
and  to  demonstrate  this  understanding  as  evidenced  by 
acceptable  performance  on  the  course  assignments  and 
ezaminat i on ( s ) . 
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"TKANSPORTABLE,  UNIVERSITY-LEVEL 
EDUCATIONAL  PROGRAMS  IN  INTERACTIVE 
INFORMATION  STORAGE  AND  RETRIEVAL  SYSTEMS," 
WAYNE  D.  DOMINICK  AND  LEROY  ROQUEMORE, 
USL/DBMS  NASA/RECON  WORKING  PAPER  SERIES 


REPORT  NUMBER  DBMS.NASA/RECON-3. 
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TRANSPORTABLE,  UNIVERSITY-LEVEL  EDUCATIONAL  PROGRAMS  IN 
INTERACTIVE  INFORMATION  STORAGE  AND  RETRIEVAL  SYSTEMS 


ABSTRACT 


Pursuant  to  the  specifications  of  a research  contract 
entered  into  in  December,  1983  with  the  National  Aeronautics  and 
Space  Administration  (NASA),  the  Computer  Science  Departments  of 
the  University  of  Southwestern  Louisiana  and  Southern  University 
will  be  working  jointly  to  address  a variety  of  research  and 
educational  issues  relating  to  the  use,  by  non— computer 
professionals,  of  some  of  the  largest  and  most  sophisticated 
interactive  information  storage  and  retrieval  systems  currently 
available  at  the  present  time. 


Over  the  projected  6—8  year  period  of  this  research 
contract,  it  is  expected  that  the  following  systems  will  be 
addressed : 


[1]  NASA  / RECON 

[2]  LOCKHEED  DIALOG 

[3]  U.  S.  DEPARTMENT  OF  ENERGY  / RECON 

[4]  U.  S.  DEPARTMENT  OF  DEFENSE  / DEFENSE  TECHNICAL 

INFORMATION  CENTER 

[5]  U.  S.  ENVIRONMENTAL  PROTECTION  AGENGY  / CSIN  - 

Chemical  Substance  Information  Network 

[6]  LAWRENCE  LIVERMORE  NATIONAL  LABORATORY  / TIS  - 
Technology  Information  System,  Intelligent  Gateway 
System. 
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This  presentation  to  Mid— South  AEDS  will  overview  some  of 
the  educational  issues  to  be  addressed  in  the  context  of 
developing  effective  educational  programs  for  training 
non— computer  professionals  in  the  use  of  very  large-scale 
interactive  information  systems. 
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OVERVIEW  OF  THE  PRESENTATION 


EDUCATIONAL  OBJECTIVES 


♦ ♦ » 


CONTRACT  FUNDING  SOURCES 


CONTRACT  TIME  FRAMES 


PARTICIPATING  AGENCIES  (PROJECTED) 


OVERVIEW  OF  COMPUTING  ENVIRONMENTS 


EDUCATIONAL  ORIENTED  CONTRACT  TASKS 


INFORMATION  SYSTEM  TOPICS  TO  BE  ADDRESSED 


FUTURES 
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EDUCATIONAL  OBJECTIVES 


EDUCATIONAL  PROGRAM  DEVELOPMENT 

Very  Large  Scale  Interactive  I S & R Systems 
***  Multiple  Systems  Orientation 

***  Multiple  Data  Bases  Orientation 

♦♦♦  University  - Level  Orientation 

***  Scientific  and  Engineering  Disciplines 

***  Non  — Computer  Professional  Audience 

♦♦♦  Fully  Transportable  Course  Materials 


EDUCATIONAL  PROGRAM  IMPLEMENTATION 

Pilot  Administration  at  USL  St  SU 
***  Pilot  Evaluation 

***  "Marketing" 

***  Implantation  / Distribution 

***  Continual  Enhancement 

***  Periodic  Evaluation 


EDUCATIONAL  RESULTS 


RESEARCH  RESULTS 


> RESEARCH  TOPICS 


> EDUCATIONAL  APPLICATIONS 
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CONTRACT  FUNDING  SOURCES 


ExlB&rx  £uadla£  years 


NATIONAL  AERONAUTICS  AND  SPACE  ADMINISTRATION  ...  1-8 

(NASA) 


DEPARTMENT  OF  DEFENSE  2 - 8 

( D o D ) 


Eaa^laa  Souxaaa 


DEPARTMENT  OF  ENERGY  ( ENERGY  / RECON  ) 2-8 

Oak  Ridge  National  Laboratory 

LAWRENCE  LIVERMORE  NATIONAL  LABORATORY  2-8 

( TIS  - Technology  Information  System  / 

Intelligent  Gateway  System  ) 

ENVIRONMENTAL  PROTECTION  AGENCY  2 - 8 

( CSIN  — Chemical  Substance  Information  Network  ) 

DEFENSE  TECHNICAL  INFORMATION  CENTER  2-8 

( DROLS  ) 

LOCKHEED  ( DIALOG  ) 2-8 


OTHER  AGENCIES  WILL  ALSO  PARTICIPATE 
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NEEDS  ANALYSIS 


COURSES  DEVELOPMENT 


COURSES  PILOT  ADMINISTRATION 


"MARKETING" 


DISTRIBUTION  / ADMINISTRATION 


EVALUATION  / ENHANCEMENT 


YEARS 

I 2 3 4 5 6 7 8 

I I 

1 1 112222 

222233 

2222333344445555666677778888 

3344445555686677778888 
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PARTICIPATING  AGENCIES  (PROJECTED) 
CURRENT  NASA  / RECON  USERS 


NASA  HEADQUARTERS 


« * « 


NASA 


SPACE  CENTERS 


/ RESEARCH  CENTERS 


Ames  Research  Center 
Goddard  Space  Flight  Center 
Jet  Propulsion  Laboratory 
John  F.  Kennedy  Space  Center 
Langly  Research  Center 
Lewis  Research  Center 

Lyndon  B.  Johnson  Space  Flight  Center 
Marshall  Space  Flight  Center 
. . . Others  . . . 


« « « 


NASA 


USER  UNIVERSITIES 


California  Institute  of  Technology 
Cornell  University 

Georgia  Institute  of  Technology 
Johns  Hopkins  University 
Massachusetts  Institute  of  Technology 
Princeton  University 
Purdue  University 
University  of  California 
University  of  Michigan 

University  of  Southwestern  Louisiana 
. . Many  Others  . . 


A FEW  OF  THE  MANY  MANY  OTHERS 

. *.  Executive  Office  of  the  President: 

• Library 

* White  House  Information  Center 

* Congress  of  the  United  States 

* All  Branches  of  DoD 

* Library  of  Congress 

* National  Bureau  of  Standards 

* Smithsonian 

* ...  Many  Many  ' Others  . . . 
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OVERVIEW  OF  COMPUTING  ENVIRONMENTS 


NASA  / RECON  - CENTRAL  COMPUTING  FACILITY 

NASA  HQ  : WASHINGTON,  DC 


( Schematic  Illustrated  on.  Subsequent  Visual  ) 


DISTRIBUTED  ACCESS  WORKSTATIONS  / TERMINALS 

/ 

***  PC  - Based  Workstations  to  Provide 

***  Terminal  Access  to  NASA  / RECON. 

***  Local  Standalone  Processing. 


NASA  COMPUTER  / COMMUNICATIONS  NETWORK 


( Schematic  Illustrated  on  Subsequent  Visual  ) 
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SCHEMATIC  OF  NASA  / RECON  CENTRAL  COMPUTING  FACILITY 


SCHEMATIC  OF  NASA  / RECON 


- 11  - 
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SCHEMATIC  OF  NASA  / RECON  NETWORK 
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EDUCATIONAL 


* * » 


* « * 


ORIENTED  CONTRACT  TASKS  ( Partial  List  ) 


NEEDS  ANALYSIS  PHASE 
**•  Identify  Target  Institutions 

***  Develop  Needs  Analysis  Questionnaire 

Survey  Targeted  Institutions 
Analy2e  Questionnaire  Results 
Phase  Evaluation  / Interim  Report 


COURSE  DEVELOPMENT  PHASE 


* « « 


* * * 


Develop  Course  Materials 


Syllabi 
Lesson  Plans 

Homework  Assignments/Keys 
•**  Usage  Assignments/Keys 

Examinations/Keys 
* * * Vi sua 1 s 

Phase  Evaluation  / Interim  Report 


COURSE  ADMINISTRATION  PHASE 
Implement  Courses 

***  1-2  Day  Intensive  Workshops 

6 Week  Mini-Course 
18  Week  Full  Semester  Course 

***  Phase  Evaluation  / Interim  Report 
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EDUCATIONAL  ORIENTED  CONTRACT  TASKS  { Partial  List  ) 

. . . Continued  . . . 


FOLLOW  - ON  PHASES 


« « * 


♦ ♦ ♦ 


♦ ♦ ♦ 


♦ ♦ ♦ 


♦ « * 


* * * 


« ♦ « 


* « * 


♦ ♦ ♦ 


Deve 1 op 
Imp  1 ement 
Conduct 


Conduct 


Coordinat 


Perform 


Perform 


Perform 


Perform 


Perform 


“Market ing“  Plan 
“Market ing“  Plan 
Regional  Seminars 
On-Site  Seminars 

e Request  Processing  / Dissemination 

Course  State  — of  — the  — Art  Enhancements 

Institutional  Surveys  / Evaluations 

Graduated  Student  Surveys  / Evaluations 

Additional  System  - Oriented  and 
Data  Base  - Oriented  Enhancements 

Periodic  Statistical  SuBunary  Reporting 
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INFORMATION  SYSTEM  TOPICS  TO  BE  ADDRESSED 
( Small  but  Illustrative  Subset  of  Topics  ) 


♦♦♦  Feature  Analysis  of  Interactive  Information 
Storage  and  Retrieval  Systems 
♦♦♦  User  Categorizations 
Data  Models 

♦♦♦  Logical  Data  Structures 
♦♦♦  Physical  Storage  Structures 
Data  Base  Definition 
***  Data  Base  Interrogation/Searching 
***  Data  Base  Report  Generation 
***  Data  Base  Update 
***  Data  Base  Redefinition 
***  Data  Base  Administrative  Functions 
Data  Base  Security  Considerations 
♦♦♦  Performance  Measurement  and  Evaluation 

♦♦♦  Bibliographic  Data  Base  Design 

♦♦♦  Bibliographic  File  Strcutures 
***  Linear  File  Organizations 
***  List  Structured  File  Organizations 
♦♦♦  Clustered  File  Organizations 

♦♦♦  Vocabulary  Control 

***  Controlled  Vocabularies 
Free  Text  Approaches 
***  Thesaurus  Support 

***  Bibliographic  Data  Base  Searching 

♦♦♦  Types/Levels  of  Search  Languages 
***  Search  Formulation  Features 
♦♦♦  Output  Generation  Features 
♦♦♦  Instruct! ona 1/D iagnostic  Features 

♦♦♦  Additional  IS&R  Application  Areas 

I S&R  Performance  Measurement  and  Evaluation 
***  Phases  of  the  PME  Life  Cycle 
***  Trad i t i ona 1 , Ob t rus i ve  User  Monitoring 
Advanced,  Unobtrusive  User  Monitoring 

♦♦♦  Future  Information  Storage  and  .Retr i eval  Systems 
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R & D ORIENTED  FUTURES 


PC  — Based  Information  System  Simulators 
& 

PC  - Based  Data  Base  Simulators 


PC  — Based  C A I Training  Mechanisms 


Multi  ~ System  Common  Command  Languages 


PC  — Based  Front  — End  Command  Language  Translators 


Specification  / Design  / Prototyping  of  a Robust 
PC  — Based  Scientist's  / Engineer's  R & D Environment 


« * « 
« ♦ * 
« « * 


Access 

Access 

Access 

♦ ♦ ♦ 


to  Multiple  I S & R Systems 
to  Multiple  DBMS  Systems 
to  R & D Support  -.Tools:  :: 
Statistical  Packages 
Graphical  Display  Packages 
S imul at  ion  / Modeling  Packages 


Specification  of  Distributed  Workstation  Functionality 


Distributed  Workstations  / Centralized  Mainframes 
Int  e r communi cation  (Up  1 oad i ng/Down loading)  Protocols 

Migration  of  All  Contract  Deliverables 
Uni  vers  i.ty  Leve  1 > High  School  — Level 
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ABSTRACT 


This  study  is  concerned  with  the  difficulties  encountered  by 
casual  users  wishing  to  use  Information  Storage  and  Retrieval 
Systems.  A casual  user  is  defined  as  a professional  who  does  not 
have  the  time  nor  desire  to  pursue  in  depth  study  of  the  numerous 
and  varied  retrieval  systems.  His  needs  for  online  searching  are. 
only  occasional,  and  not  limited  to  a particular  system. 

The  paper  takes  a close  look  at  the  state  of  the  art  of 
research  concerned  with  aiding  casual  users  of  Information 
Storage  and  Retrieval  Systems.  Current  experiments  such  as 
CONIT,  I IDA,  CITE  and  CCL  are  presented  and  discussed.  Comments 
and  proposals  are  offered,  specifically  in  the  areas  of  training, 
learning  and  cost  as  experienced  by  the  casual  user.  An 
extensive  bibliography  of  recent  works  on  the  subject  follows  the 
text  . 


KEYWRDS 


Man/Machine  Interface,  Information  Storage  and  Retrieval  Systems, 
Casual  User,  User/System  Interaction,  CAI , CAT,  Assistance,  Help, 
CCL,  CITE,  CONIT,  I IDA,  LEXIS,  TRAIN. 
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THE  M\N /MACHINE  INTERFACE 
IN 

INFORMATION  RETRIEVAL: 
PROVIDING  ACCESS 
TO  THE 
CASUAL  USER 


1 . INTRODUCTION 

This  age  we  are  living  in  has  been  labeled  by  many  as  the 
"Information  Age.”  Since  the  1960’s,  we  have  seen  a tremendous 
growth  in  technology,  which  has  made  possible  the  creation  of 
online  retrieval  systems.  It  came  right  on  time,  because, 
simultaneously,  the  quantity  of  documents  and  publications 
available  has  experienced  an  expansion  never  seen  before.  There 
would  be  no  way  for  the  old  structures  - libraries  and  published 
indices  - to  keep  up  with  such  a growth,  if  it  were  not  for  the 
development  of  technology.  However,  all  is  not  beautiful  for  the 
user:  indeed,  data  is  available  much  faster  and  more  c omp  1 e t e , 
but  so  far  it  has  been  necessary  for  the  user  to  retrieve 
information  through  an  intermediary,  such  as  a librarian  or  an 
information  specialist.  This  paper  will  study  what  are  the 
challenges  to  the  untrained  users  of  online  retrieval  systems,  as 
well  as  the  options  for  the  future. 
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2.  STATING  THE  PROBLEM 

Online  retrieval  systems  have  been  very  well  accepted  by  the 
user  comnunity,  since  their  early  debuts,  in  the  late  60’s.  The 
tremendous  growth  in  technology  which  has  happened  in  the 
computer  field,  has  been  reflected  in  all  areas  of  data 
retrieval;  research  in  networking,  reliability,  memory  size  and 
speed,  all  had  important  and  constructive  consequences  in  the 
information  retrieval  area.  During  the  same  period  the  number  of 
databases  has  multiplied,  as  well  as  the  number  of  records  in 
every  one  of  them.  By  the  end  of  the  1970’s,  the  number  of 
online  searches  per  year,  increased  from  1 million  to  2 million 
and  since  then,  th’e  growth  has  ke^t  the  same  fantastic 
progress  ion . 

With  the  rapid  proliferation  of  data  available  on  line,  and 
the  general  acceptance  by  the  general  user  comnunity  of  this  way 
of  searching,  new  problems  have  appeared.  One  of  them  is  the 
*liff  iculty  for  an  occasional  user  to  search  a database 
effectively,  without  human  help  such  as  from  a professional 
searcher  or  a librarian.  In  order  to  access  conmercial  systems, 
the  searcher  must  follow  a rigid  code:  logging  in  procedures, 
manipulation  language,  error  messages  and  help  online  differ 
widely  from  one  system  to  another.  All  claim,  to  a certain 
extent,  to  be  "user  friendly”,  (or  even  better  "ergonomic!”),  but 
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that  is  seldom  the  opinion  of  the  end-user? 

2.1  The  Intermediary 

To  remedy  these  difficulties,  a quite  general  approach  in 
business  and  university  environments  is  for  the  person  in  need  of 
info  rma  tion  to  go  to  a professional  searcher,  we  11  trained  for 
online  searching,  and  to  use  him  as  an  "interface”?  Generally, 
is  thought  that  only  between  10%  and  15%  of  the  searches 
being  performed  are  performed  by  the  end-users  themselves 
[Wanger  , 79]  . 

However,  for  reasons  which  are  explained  in  this  report,  it 
can  be  interesting  for  users  to  perform  the  searches  by 

themselves,  instead  of  through  an  intermediary,  as  the  case 

normally  is.  The  advantages  of  having  a professional  searcher 
working  online  are  tremendous,  there  are  no  doubts  about  that; 

but  some  difficulties  exist,  such  as  comnunicat ion  between  user 

and  searcher,  time  frame,  availability  of  each  party,  and  other 
incompatibilities.  Furthermore,  the  user  could  very  well  benefit 
from  hand— on  experience,  and  even  retrieve  information 
"accidentally",  perhaps  by  discovering  new  keywords  while  online 
or  modifying  search  strategies  while  online. 
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2.2  Problems  and  Challenges 

It  is  also  important  for  the  reader  to  realize  that  the 
success  and  the  growth  of  interactive  bibliographic  retrieval 
systems  have  been  such  that  users,  in  recent  years,  have  found 
themselves  facing  huge  challenges.  The  difference  between  the 
systems  available,  their  organizations,  indices,  thesauri, 
retrieval  languages  and  procedures  make  occasional  searching 
quite  an  enterprise.  Some  kind  of  standardization  is  clearly 
overdue,  but,  in  the  meantime,  what  should  be  done? 

Recently,  many  efforts  have  been  made  to  make  online 
bibliographic  retrieval  systems  easier  to  use  by  the  end  user. 
In  fact,  since  the  early  days  of  computers,  designers  have 
attempted  to  befriend  the  users:  from  user  training  and  online 

help,  to  the  use  of  a "mouse,”  the  promises  are  many.  However, 
problems  remain,  and  we  will  examine  the  ones  users  of  online 
retrieval  systems  encounter. 

In  the  retrieval  syst  ems , the  probl em  i s two  fold: 

(1)  On  one  hand,  it  is  extremely  difficult,  if  at  all 
possible,  for  the  end  user,  to  perform  searches  well 
and  efficiently,  if  he  has  not  acquired  some  kind  of 
practice,  and  even  expertise  in  the  system  he  wishes 
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to  use . 

(2)  On  the  other  hand,  how  is  he  to  acquire  this 
experience  if  his  searching  needs  are  not  only 
occasional,  but  also  require  the  use  of  various 
sy s t ems  ? 

Here  is  a perfect  ^Catch  22’’,  which  many  have  tried  to 
circumvent.  This  paper  will  study  the  different  approaches 
possible,  in  order  to  resolve  the  problems  facing  a casual  user 
desiring  to  search  information  online  by  himself. 

2.3  The  Casual  User 

A user,  let’s  say  a scientist,  whose  searching  needs  are 
only  occasional  does  not  wish  to  spend  long  and  repetitive 
sessions  learning  how  to  use  a specific  system.  He  could  very 
well  do  it,  as  his  intellectual  faculties  are  not  in  question, 
but  he  does  not  have  the  time  - nor  the  desire  - to  study  query 
languages  he  will  use  only  one  or  two  times  a year. 

For  the  purpose  of  this  paper,  a person  whose  knowledge  in 
online  retrieval  is  limited,  and  whose  extent  of  experience  in 
this  form  of  search  is  only  minimal  and  occasional,  will  be 
defined  as  a ”casual  user”.  The  casual  user’s  understanding  of 
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the  system  is  limited  to  the  generalized  concepts  of  records, 
indexes  or  keywords.  Throughout  this  paper,  and  unless  specified 
otherwise,  a ”user"  will  mean  a **casual  user”  as  defined  above. 

Let’s  observe  a casual  user  wishing  to  have  access  to  a 
retrieval  system.  He  is  unfamiliar  with  the  search  procedures, 
the  comnand  language,  the  database.  Even  more,  he  could  be  a 
novice  in  the  use  of  a terminal  or  logging  in  procedures.  He 
needs  help!  The  most  likely  option  for  him,  at  this  point,  is  to 
go  to  a professional  ”searcher”  (l)  and  formulate  his  wishes. 
However,  a problem  of  c oninun i c a t i on  will  rapidly  take  place  if 
the  professional  searcher  does  not  have  some  knowledge  in  the 
scientist’s  field.  The  best  solution,  in  order  to  remedy  this 
specific  difficulty,  is  for  the  two  of  them  to  work  and  search 
together.  Of  course,  the  solution  is  far  from  ideal  (2)  : a gap 
still  exists  between  the  two,  and  frustration  is  quite  likely  if 
errors  or  delays  result.  What  is  more,  the  user  always  needs  his 
information  ” inmed i a t e ly ” , when  the  professional  has  some  "other 
urgent  matters  to  attend  to,  before  proceeding  with  this 
r eque  s t . . . ” 


(1)  In  a university  environment,  a librarian  would  have  the 
appropriate  training. 

(2)  Even  if  it  is  the  mo  s t r e comnended  approach. 
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2.4  "Leave  the  Casual  User  Alone!” 

Thus,  there  exist  many  cases  when  the  user,  the  "scientist” 
from  above,  would  like  to  perform  his  searches  by  himself.  By 
doing  so,  he  will  have  more  freedom  and  he  will  get  the  feeling 
of  moving  in  "terra  cognita”:  after  all,  those  formulas,  those 
scientific  names,  if  they  have  no  meanings  to  the  librarians, 
they  should  have  some  for  him...  Above  all,  performing  his  own 
search,  the  user  has  the  opportunity  to  "browse”  through  the 
records,  like  he  would  do  about  library  shelves.  It  is  because 
of  all  these  points,  that  it  has  bee  ome  interesting  to 
investigate  the  feasibility  of  systems  which  would  allow  casual 
users  to  search  the  databases  without  external  help. 

However,  as  we  will  see,  the  options  and  the  problems  are 
niunerous.  The  options  are,  for  example,  to  train  the  occasional 
user  in  a quick  and  easy  way,  but  the  problems  there  are  too 
clear:  which  shortcuts  are  acceptable?  Others  options  are  to 
simplify  the  language(s)  needed  to  access  a system.  As  long  as 
some  "standard  languages"  do  not  exist,  would  it  not  be  good  to 
have  a language  allowing  access  to  different  systems?  It  would 
also  be  valuable  to  have  interfaces  "counseling”  the  users, 
before  sending  the  queries  to  the  commercial  system:  users  would 
save  time,  money  and  much  irritation.  Those  solutions  have  been 
investigated  already,  and  this  paper  will  detail  them  to  the 
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reader,  with  their  good  and  their  bad  points.  Other  ways  are 
open,  as  will  also  be  shown . 

2.5  Goal  of  the  Paper 

The  author  of  this  paper  firmly  believes  that  online  system 
searches  benefit  from  user  involvement.  Thus  this  paper  is  going 
to  study  ways  to  guide  an  inexperienced  user  through  the  maze  of 
the  searching  world.  It  is  first  going  to  study  the  question  of 
training  the  users,  and  then  different  systems  which  have  been 
realized  during  the  past  few  years,  all  in  the  hope  of  curing  the 
unfriendliness  of  retrieval  systems  toward  inexperienced  users. 
Finally,  the  author  will  offer  some  personal  remarks,  comments, 
predictions  for  the  near  future,  as  we  11  as  s ome  guidelines  for 
user-friendly  syst  ems  . 


3 . EDUCATION 

The  easiest  way  to  have  users  able  to  fully  use  a system,  is 
to  give  them  some  kind  of  formal  training*  Most  comnercial 
system’s  vendors  will  be  pleased  to  send  representatives  of  their 
organizations,  in  order  to  train  the  future  users.  For  several 
days,  within  a classroom  or  online  using  some  "canned  example," 
the  naive  users  will  slowly  lose  their  innocence! 
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Manuals  are  also  of  great  value,  of  course,  and  should 
always  be  available.  They  describe,  hopefully  in  laymen’s  terms 
the  how  - and  sometimes  the  why  - of  each  comnand.  If  the 
instruction  ma  nuals  are  considered  insufficient  or,  mo  re  often, 
too  complex  for  beginners,  simpler  guides  are  available, 
explaining  commands  step  by  step,  (l) 

This  paper  stated  earlier,  however,  that  a casual  user  does 
not  have  the  time  nor  the  desire  to  sit  in  a formal  classroom  in 
order  to  be  taught  all  the  tricks  and  short  cuts  of  a system  he 
will  use  only  once  or  twice  a year.  In  this  section,  the  reader 
will  find  only  a quick  overview  of  some  of  the  most  original 
approache  s . 

3.1  CAI/CAL  or  Computer  Assisted  Instruction/Computer  Aided 

Learning 

In  this  section,  the  reader  is  invited  to  consider  that  some 
form  of  training  seems  indispensable  for  any  user:  the  question 
is  how  little  is  enough,  and  how  in  depth  can  it  be  without 
bothering  the  casual  user*  For  these  reasons,  the  formal  type  of 
training  is  not  analyzed  in  this  study.  The  literature  on  the 


(1)  For  example,  Robert  Laurence  wrote  a ”Self  Teaching  Exercise” 
for  LEXIS,  which  is  a textbook  at  the  University  of  Illinois  Law 
School  [Laurence,  78]. 
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subject  refers  to  Computer  Assisted  Instruction  (CAI),  to 
describe  training  offered  online.  There  are  two  types  of 

instruction  which  can  be  differentiated: 

(1)  The  first  type  is  the  instruction  as  offered  by  an 

online  system.  TRAIN,  for  example,  is  offered  online 
by  DIALOG.  This  category  has  not  been  specifically 
designed  for  casual  users,  and  it  is  often  time 
consuming  and  expensive.  Thus  it  will  only  be 

me ntioned  here. 

(2)  The  second  type  is  CAI  as  a "canned  exercise".  In 

this  case,  the  student  is  instructed  offline,  by 
examples  and  exercises,  using  simulation,  emulation  of 
a system,  or  a subset  of  a system’s  databases.  This 
solution  has  the  double  advantage  of  being  cheaper 
and,  potentially,  more  individualized  (ie:  designed 

for  a specific  class  of  users).  In  this  class,  one  of 
the  most  interesting  and  most  successful  cases  is  the 
TRAINER , described  bel  ow. 

3.2  TRAINER 

The  University  of  Pittsburgh  has  a CAI  system,  called  the 
TRAINER  system,  which  has  been  in  operation  since  1978  [Caruso, 
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78].  It  provides  both  instruction  and  training  for  online 
searching,  and  teaches  users,  by  emulation,  how  to  use  a 
retrieval  system.  That  is,  it  simulates  the  functions  of 
retrieval  systems,  and  allows  users  to  obtain  training,  without 
using  expensive  conmercial  service  connect  time  and  telephone 
c onne c t i ons  . 

TRAINER  was  developed  by  Elaine  Caruso,  under  an  NSF  Grant 
[Caruso,  77],  It  helps  users  to  learn  how  to  access  a system  and 
operate  searches  in  an  economical  way,  with  feedback,  and  no  time 
pressure,  because  the  trainee  is  not  connected  to  comnerical 
systems  while  exe r iment i ng . The  TRIANER  system  teaches  users  to 
operate  retrieval  systems  by  emulating  them  on  a stand  alone 
computer . 

The  user  can  use  DIALCXj-like  comnands,  or  ORBIT-1  ike 
conmands  in  order  to  emulate  actual  searches.  The  searches  are 
performed  on  a subset  of  Lockeed  (for  DIALOG)  and  SDC  (for 
ORBIT),  accessing  3 data  files,  and  the  entire  session  looks  like 
real  DIALOG  and/or  ORBIT. 

A user  who  does  not  wish  to,  or  can  not  spend  time  in  a 
classroom,  but  would  benefit  from  a session  of  training,  would  be 
a good  candidate  for  TRAINER.  At  his  own  pace,  he  could  choose 
any  of  the  seven  instruction  modules  available,  or  directly  go  to 
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the  emulation  modules,  and  start  familiarizing  himself  with  them. 

The  advantages  are  reduced  cost,  because  no  online 
connections  with  the  commercial  systems  are  required  (l)  and 
convenience,  as  the  user  gets  trained  on  two  widely  used  systems, 
at  his  own  speed  and  when  he  wishes.  What  is  more,  a casual  user 
can  easily  select  the  TRAINER’S  exercises  he  needs,  and  get 
information  and  training  on,  and  only  on,  a particular  subset. 
The  capabilities  offered  by  individualized  training  are  one  of 
the  requirements  needed  in  order  to  please  a casual  user. 

However,  there  exists  some  important  limitations,  the  major 
one  being  that  the  training  is  done  on  a very  restrictive  subset 
of  the  databases.  Also,  the  code  is  written  in  ANSI  FORTRAN, 
certainly  not  the  best  choice  for  data  and  string  processing. 
Also,  the  portability  of  the  system  is  far  from  being  adequate: 
the  TRAINER  runs  at  University  of  Pittsburgh,  on  a PDP  11/40  and 
many  attempts  to  export  the  system  have  only  shown  that  TRAINER 
likes  DEC  best  [Caruso,  81]! 

After  this  very  rapid  overview  of  what  kind  of  training  is 
available  online  to  the  casual  user,  the  next  chapter  of  this 
paper  is  going  to  take  a close  look  at  the  way  some  systems  have 


(l)  TRAINER  is  available  for  dial-up  access  through  the 
educational  network  EDUNET/TELEINET . 


1 DHVB  .NASA/RECON-4  I 


17 


I MAN/M\CHINE  I 


I N A S A I 


I NASA  I 


approached  the  problem  of  casual  users  desiring  hands-on 
exper i ence . 


4.  STATE  OF  THE  ART 

In  the  next  few  sections,  some  systems,  research  and 
experiments  will  be  presented.  Each  one  of  them  has  been 
selected  because  its  particular  approach  in  handling  casual  users 
is  original  and  of  importance.  The  selection  was  also  based  upon 
the  availability  of  literature  and  published  material,  (l) 

First,  LEIXIS  will  be  presented  as  a conmercial  system 
intended  for  a casual  user  conmunity.  Then  CONIT,  a research 
project  at  MIT,  will  be  explained  and  will  show  how  it  is 
possible  for  a user  to  access  many  retrieval  systems  using  a 
single  language  and  a set  of  procedures.  IIDA,  from  Drexel 
Uni  vers i ty  wi  1 1 give  the  example  of  a system  helping  the  searcher 
to  search  ’’well”.  Finally  CITE  wi  1 1 give  an  example  of  a natural 
language  approach. 


(l)  Which  explain  the  number  of  NSF  grants  studied  in  this  report 
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4.1  LEXIS 

4.1.1  Presentation 

The  first  system  this  paper  has  chosen  to  study  is  LEXIS. 
There  are  many  reasons  for  this  choice,  the  most  important  one  is 
the  fact  that  LEXIS  has,  indeed,  been  created  for  a **casual  user” 
conrnunity,  as  defined  earlier.  Another  reason  is  the  wide 
acceptance  of  this  system  in  this  country  and  overseas.  Finally 
the  ease  of  use,  and  the  little  training  required  makes  the 
experience  worth  being  studied. 

One  of  the  most  successful  examples  of  online  retrieval 
system  for  casual  users  is  given  by  Mead  Data  Centrales  LEXIS, 
and  the  newer  NEXIS  and  LEXJPAT,  (however,  for  the  present  study, 
only  LEXIS  will  be  discussed,  as  the  3 systems  are  quite  similar, 
and  LEXIS  is  by  far  both  better  known,  and  more  heavily  used). 

LEXIS  was  created  in  1967  (l)  and  started  its  nationwide 
expansion  in  1973.  It  was  designed  to  be  an  interactive 
time-sharing  system,  specially  molded  for  lawyers*  use.  Its 
databases  contain  full  text  of  all  federal  cases,  as  well  as 
state  cases  in  dozen  of  states,  and  other  specialized  libraries. 


(1)  Back  then,  LEXIS  was  known  as  OBAR  (**Ohio  Bar  Automated 
Re  search** ) . 
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The  user  has  also  access,  with  special  billing,  to  DIALCX3,  New 
York  Times  Information  Bank,  Encyclopaedia  Britannica  and  NEXIS. 
The  hardware  and  retrieval  procedures  have  been  designed  with  the 
legal  comnunity  in  mind,  and  the  legal  community  is  a perfect 
example  of  a comnunity  of  "casual  users”  as  described  above. 
Lawyers  are  professionals,  who  certainly  feel  that  their  time  is 
valuable  -at  least,  it  is  expensive?-.  They  do  know  how  to 
search,  as  they  are  familiar  with  the  concepts  of  keywords, 
indices  and  abstracts  which  they  use  in  their  libraries,  but  most 
of  them  are  c omput e r- i 1 1 i t e r a t e s . LEXIS  answers  most  of  the 
legal  conmunity’s  needs. 

By  the  end  of  1983,  LEXIS  functioned  on  two  Amdahl  5860 
mainframes,  located  in  the  Mead  Center,  in  Dayton,  Ohio*  The 
network  is  the  Med-Net  Network  and  the  terminals  needed  by  the 
users  are  owned  by  LEXIS  (however,  because  competition  is  now 
shaking  the  market  (l)  , LEXIS  is  now  also  available  to  the 
owners  of  IBM  PCs,  IBM  3101,  IBM  Display-Writer  and  Televideo  950 
t e rmi  na 1 s ) * 

4*1.2  Searching  LEXIS 


(l)  Note:  In  the  US,  competition  to  LEXIS  is  composed  mainly  of 
WESTLAW,  JURIS  (Justice  Retrieval  and  Inquiry  Systems),  AUTO-CITE 
(Automated  Citation  Testing  Service)  and  ELITE  (Federal  Legal 
Information  Through  Electronics). 
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A LEXIS  user  will  typically  search  words  or  sentences  within 
a text;  Boolean  logic  is  used,  and  a few  coninon  words  are 
eliminated.  It  is  a full-text  system,  with  no  pre- index i ng , and 
therefore  the  user  can  search  the  entire  text  for  a wo r d or  a 
sentence.  But  what  makes  LEXIS  especially  interesting,  and  that 
is  why  it  is  discussed  in  this  paper,  is  its  ability  to 
conxnunicate  in  plain  English.  The  function  keys  are  numerous  and 
clearly  marked.  For  example,  some  are  labelled:  NEXT  PAGE,  NEXT 

CASE,  HELP,  CHANGE  FILE,  QiANGE  LIBRARY  ... 

The  following  function  keys  are  worth  being  mentioned: 

(1)  FULL  displays  the  full  text. 

(2)  CITE  gives  title,  date  and  formal  citation 

(3)  KWIC  shows  searchword  in  context  (25  words) 

(4)  THESAURUS  will  suggest  synonymous,  related  terms. 

(5)  CLIENT  will  help  billing  client  to  relevant  searches. 

LEXIS  allows  features  which  are  quite  interesting,  all  very 
easy  to  use,  such  as  a search  in  a range,  where  the  user  can  find 
a keyword  within  ”n”  words  of  another  keyword. 
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For  example:  ’louisiana  w/5  university’  will  retrieve  all 
occurrences  of  the  citations  mentioning  both  words  within  5 words 
of  each  other,  with  the  searchwords  highlighted,  (l) 

According  to  MEAD’ s recent  publicity,  the  average  session 
online  lasts  15  minutes,  and  the  average  time  for  retrieval  is 
typically  15  seconds. 

4.1.3  LEXIS  Conclusion 

In  its  limited  area,  legal  searches,  LEXIS  has  triumphantly 
resolved  the  problem  of  a casual  user  accessing  an  online  system 
without  external  help.  It  is  possible  for  a user  to  sit  at  a 
terminal,  without  prior  experience,  and  to  retrieve  meaningful, 
and  complete  information  in  a reasonable  amount  of  time.  Thus, 
LEXIS  has  seen,  since  1975,  the  creation  of  many  associations  of 
users,  in  local  law  libraries  and  bar  association.  In  those 
environments,  users  are  clearly  occasional  searchers:  it  is 
because  of  their  rare  need  for  online  retrieval,  that  those 
lawyers  could  not  justify  a personal  subscription  to  the  MEAD’s 
system.  LEXIS  does  seem  to  satisfy  the  casual  users  in  the  legal 
world  [Larson,  80]. 


(l)  In  "LEXIS  Legal  Research”,  published  and  distributed  by  Mead 
Data  Central  to  prospective  clients.  Copyright  1982  MX!  (pp.  11). 


I DBMS. NASA/ RECON- 4 I 


22 


I MAN/MACHINE 


I N A S A I 


I N A S A I 


LEXIS  has  also  resolved  the  problems  inherent  to  the  most 
traditional  type  of  searching  such  as  the  ti me  lag  before  hard 
copy  is  available  and  the  subjectivity  brought  by  indexing:  the 
time  lag  is  negligible  (l)  , and  the  subjectivity  is  absent,  as 
indexing  has  disappeared.  And  since  indexing  has  disappeared, 
all  data  is  searchable. 

But,  non-indexing  has  also  its  drawbacks.  The  main  argument 
against  it  is,  of  course,  the  fact  that  many  irrelevant  documents 
are  retrieved.  It  is  also  frequent,  for  somebody  not  familiar 
with  the  laws  and  the  legal  vocabulary,  to  miss  some  cases,  maybe 
some  important  ones.  In  other  words,  it  can  be  said  tiat  the 
role  of  the  indexer  has  always  to  be  assumed  by  somebody.  In 
full-text,  the  searcher  himself  has  to  play  the  role  of  the 
indexer . 

Because  of  those  points,  the  use  of  LEXIS  is  incompatible 
with  users  who  do  not  know  well  the  world,  and  the  vocabulary  of 
the  legal  environment.  It  is  also  impossible  for  a searcher  to 
perform  well  as  long  as  he  has  not  identified  relevant  terms  and 
searchwords.  Thus,  LEXIS  has  gone  a long  way  from  more 
traditional  retrieval  systems:  a LEXIS*  searcher  will  perform 


(l)  The  time  lag  could  eventually  completely  disappear,  if  and 
when  the  court  reports  and  laws  are  entered  directly  in  the 
databases,  a possibility  not  c omp letely  utopian. 


I DHVIS.  NASA/ RECON- 4 I 


23 


I MAN/MACHINE  I 


I N A S A ! 


I N A S A I 


well  as  long  as  he  knows  his  domain.  His  expertise  in  law  is 
primordial,  and  knowledge  in  other  conventional  systems  would  not 
help  him  very  much. 

The  domain  of  legal  research  will  change  quickly  in  the  mid 
80  s.  The  concept  of  full-text  retrieval  is  clearly  favored 
among  lawyers,  but,  as  the  size  and  number  of  files  increase,  it 
is  clear  that  mo  re  research  is  needed  in  order  to  keep  retrieval 
speed  and  efficiency  at  the  high  standards  which  are  known  today, 
(l)  As  Users  become  more  numerous,  and  require  more  searches, 
they  are  likely  to  ask  more  from  these  systems  which  have 
performed  so  well  in  the  past. 

There  is  also  considerable  competition  on  the  legal  market. 
We  s 1 1 aw , LEIX  IS*  ma  j o r c omp  etitor  has  ma  de  great  progress  in  the 
past  five  years.  It  has  added  full  text  search  capability,  once 
unique  to  LEIXIS,  while  keeping  its  **key-numbe  r ” system,  so 
familiar  to  lawyers.  (2)  Also,  We  s 1 1 aw  is  compatible  with  almost 
any  hardware  on  the  market,  an  issue  of  interest  to  small  firms, 
and  which  LEXIS  will  have  to  accept. 


(1)  Many  authors  argue  that  the  growth  has  attained  some  maximum, 
and  that  increases  are  likely  to  slow  down.  However,  as  more  and 
more  cases  are  being  argued,  and  retrospective  material  is  being 
added,  the  size  of  legal  databases  will  continue  to  grow  for  the 
next  f ew  years . 

(2)  West  Publication  is  the  major  legal  publisher  in  the  U.S. 
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Thus,  the  casual  user  seems  to  be  the  winner  in  the  legal 
profession:  the  quality  of  past  service  and  the  new  competition 
have  forced  LEXIS  to  improve,  and  users  can  expect  extended 
services  in  the  years  to  come.  Finally,  it  should  be  noted  that 
LEXIS  is  also  remarkable  by  the  fact  that  even  if  it  allows  easy 
use  for  the  infrequent  user,  it  does  so  without  inhibiting  the 
experienced  searchers:  very  "fancy”  searches  are  possible  on  the 
system.  Thus,  the  two  class  of  users  — casual  and  experienced  — 
are  united  under  the  same  interface,  which  is  a rare  achievement. 


4.2  CONIT 

CONIT,  for  "COnnector  for  Networked  Information  Transfer,” 
is  one  of  the  best  examples  of  an  attempt  to  help  the  casual  user 
of  information  retrieval.  It  is  an  experimental  computer 
interface  which  was  developed  at  MIT,  by  the  Electronic  Systems 
Laboratory,  under  Richard  S.  Marcus.  The  system  was  designed  to 
provide  a translating  tool  between  the  users  and  various 
retrieval  systems.  CONIT’s  success  has  been  demonstrated 
experimentally,  and  it  has  been  used  as  a basis  for  other 
pro  ject s . ( 1 ) 


(l)  For  ex  amp  1 e , see  II DA , further  in  this  paper. 
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4.2.1  Presentation 

CXDNIT  allows  the  user  to  access  many  different  retrieval 
systems,  using  a conxnon  language,  during  a continuous  session. 
Usually,  the  heterogeneity  offered  by  a group  of  systems  creates 
obstacles  at  different  levels:  the  user  must  know  different 
access  procedures,  in  order  to  log-in  and  to  exit  the  system.  He 
must  also  know  different  languages  in  order  to  perform  searches 
and  request  outputs.  Finally,  he  must  be  aware,  even  if  only 
slightly,  of  the  indexing  vocabularies  and  the  retrieval 
capacities  of  the  system.  As  a matter  of  fact,  even  within  a 
given  system,  it  is  possible'  to  find  differences  in  indexing 
methods  and  other  inconsistencies,  like  dif.ference  in  catalog 
record  fields . 

The  approach  used  by  CONIT  is  quite  original:  it  can  be 
described  as  an  attempt  to  present  to  the  user  a single  "virtual 
system,”  with  a single  manipulation  language.  The  virtual  system 
consists  of  many  conxnercial  retrieval  systems,  with  all  their 
complexity  and  originality  preserved.  However,  to  the  user,  all 
those  system  "look  like”  a unique  and  homogeneous  system. 

CX5NIT  works  on  the  MIT’s  MLTLTICS  system.  Currently  it  can 
access  four  conxnercial  retrieval  systems:  Lockeed  DIALOG,  SDC 
ORBIT,  NLM  and  SUNY  Medline,  as  well  as  MIT’s  own  "INTREX.” 
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MULTICS  accesses  those  systems  through  a device  called  the 
^’autocall.^  Autocall  takes  care  of  dialing  the  system’s  number, 
and  informing  the  user  of  the  reasons  for.  delay,  if  they  occur. 

Th  e CX)N  IT  interface  provides  a c onmo  n access  to  a ne  two  r k 
of  different  online  bibliographic  retrieval  systems.  The  user 
views  a global  or  virtual  system,  which  he  accesses  through  a 
conrnon  language.  That  offers  a flexible  and  dynamic  means  for 
handling  the  interconnection  between  the  searcher  and  the 
database  . 

4.2.2  Study  of  CX)NIT 

The  language  used  by  CONIT  was  designed  in  such  a way  that 
all  of  the  functions  needed  for  information  retrieval  operations 
can  be  expressed.  Thus,  each  language  L( i ) from  the  original 
systems,  has  been  broken  down  to  its  most  elementary  pieces:  each 
one  of  the  elementary  pieces  is  unique,  that  is,  two  different 
languages  will  not  have  two  similar  elementary  pieces,  unless 
their  meaning  is  equivalent  to  each  other.  From  those  unique 
parts,  a conmon  language  function  is  built  as  a MACRO  of  the 
comnon  language . 

The  structure  of  the  language  is  always: 
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(1)  VERB  (which  is  a Conmand). 

(2)  A space . 

(3)  An  argument  (where  an  argument  can  be  a list  of 
a r g ume  n t s ) . 

The  verbs  can  be  abbreviated,  and  space  and  a r g ume  n t s are 
not  a Iway s r equ i red • 

4.2.3  Searching  with  CXDNIT 

The  stream  of  input  coming  from  a user,  or  from  a system  in 
response^  to  a user^s  request,  is  ma tched  against  a set  of  rules. 
The  advantage  of  matching  strings  against  a table  is  that  the 
number  of  rules  can  be  varied  over  time,  and  the  rules  modified 
if  necessary.  Also,  the  rules  are  organized  in  such  a way  that 
longest  matches  occur  first:  thus,  a rule  NNNN  will  match  first 
an  incoming  string  NNNN.  But,  if  a match  does  not  happen,  a rule 
NNNX  would  be  checked  for  matching,  and  the  process  repeated 
until  the  end  of  the  table  is  reached.  This  smart  approach  has 
helped  keep  the  number  of  rules  to  a very  sma 1 1 numbe r . ( 1 ) 

An  example  of  a rule  can  be  given  by: 


( 1 ) In  CON IT  3,  less  than  80  (basic)  rul  es  were  necessary 
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RLE — 3 /TELENET/ /Te lenet  Respond! ng /RLE : : 4/ Send 
1/2//  4 /5/6 


wh  ere: 

* 

1 is  the  Context  String  (the  State  at  Start). 

2 is  the  Match  String  (the  Incoming  String  to  be  Matched). 

3 is  the  Host  Message  (the  Message  for  the  System,  if  any). 

4 is  the  User  Message  (the  Message  for  the  User,  if  any). 

5 is  the  Next  String  (the  Next  State). 

6 is  the  Special  Action  (if  Action  is  Required). 

The  meaning  of  the  rule  in  this  case,  would  be: 

1 

R for  Retrieval  System  : the  message  comes  from  system- 
L for  Logging  Procedure  : we  are  in  the  Logging  stage. 

E for  Telenet  : the  network  is  Telenet. 

- for  ”do  not  care”  : any  character  would  match. 

3 for  step  3 of  Logging. 
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2 TELENET  is  the  string  to  match. 

3 no  message  for  the  host,  since  host  is  the  sender. 

4 ’’Telenet  Responding”  message  is  sent  to  user. 

5 Next  Context  is  R,  L,  E,  : (do  not  care)  and  step  4. 

6 If  match  occurs  ==>  action. 

As  a further  example  of  conmands,  and  capabilities  of  the 
system,  the  reader  is  invited  to  consider  the  following  examples. 

A user  entering  the  conxnand: 

— > PICK  SYSTEVt^NAME 

would  initiate  the  following  procedures,  which  will  occur  without 
any  further  conmands  from  the  user’s  part: 

(1)  Send  message(s)  informing  user  of  ”what’s  going  on.” 

(2)  Dial  the  correct  number  of  the  network 
(Tymne t /Te 1 ene t ) , via  the  autocall. 

(3)  Inform  the  user  of  how  to  leave  the  system 
(di sconnect ) . 
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(4)  And  send  the  following  messages,  as  soon  as 

appropr i a t ed : 

(a)  Phone  connection  made  with  [Tymne t /Te 1 ene t ] . 

(b)  [Tymne t /Te 1 ene t ] responding, 

(c)  Logging  into  [System-Name], 

(d)  You  are  now  connected  to  the  [System-Name] 
re  tr i eva 1 sy s tern, 

>>>>  At  this  point,  the  user  will  choose  a particular 
database:  (i.e.:  "SOCIAL  SCIENCE  (No  51)”) 

(e)  You  are  now  connected  to  the  [SOCSCI  (NIMBER  51)] 
database  • 

« 

(f)  For  explanation  of  how  to  find  a document,  type: 
’e  f ind’ . 

and  finally,  the  user  is  logged  in.  In  the  previous  example,  the 
user  would  be  logged  in,  ready  to  use  the  database  of  his  choice. 

In  most  of  the  cases,  however,  the  casual  user  will  not  have 
to  bother  about  selecting  a specific  syst  em,  Af  ter  a : 

> SHCW  DATA 

comnand,  CONIT  will  indicate  a set  of  available  "areas  of 
interest”.  From  this  set,  the  user  will  select  one  group.  Let’s 
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assume  for  the  sake  of  example,  that  the  user  wants  to 

investigate  the  area  of  Social  Sciences  (No  51).  He  will  type: 

> PICK  51 

Note,  that  all  he  had  to  do,  was  to  select  an  area  of 
interest:  very  often  the  casual  user  is  not  interested  in  knowing 
which  system  brings  him  the  information.  CONIT  will  select  a 
system  according  to  system  selection  rules,  which  can  be 

overridden  by  the  user  at  his  choice.  Two  of  the  most  important 
rules  are: 

If  a system  is  already  online,  use  that  system. 

If  MEDLINE  is  desired,  use  SDNY,  instead  of  NIM,  since 
SUNY  is  cheaper  and  often  less  busy. 

Note  also,  that  in  order  to  switch  from  SYSTEM-NAME  to 
SYSTEM-2,  the  user  will  only  need  to  type: 

— > PICK  SYSTEM-2 

and  all  of  the  necessary  logging  out  from  SYSTEM-NAME,  dialing 
and  logging  in  to  SYSTEM-2  will  be  taken  care  of  by  CONIT. 

It  is  now  possible  to  search,  change  database,  consult  the 
index,  request  outputs  and  keep  the  results  of  searches  in  an 


(1) 

(2) 
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out-file  for  later  consultation. 

4.2.4  Comparing  the  Languages 

On  page  34,  the  reader  will  find  some  examples  of  the  CONIT 
requests.  They  have  been  compared  to  the  DIALOG  and  ORBIT 
requests  they  simulate.  A column  of  MADAM  equivalent  comnands 
has  been  added  for  references  (MADAM  is  a retrieval  system  which 
has  been  developed  at  USL , Lafayette,  LA,  where  this  paper  was 
also  written).  SUNY  and  NLM  Medline  examples  have  not  been 
given,  because  their  syntax  is  very  similar  to  the  language  used 
by  ORBIT. 

Note  that  translations  are  necessarily  approximate,  since 
exact  translations  are  impossible,  as  will  be  shown  later  in  this 
paper  . 
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CONIT  I DIALOG  I ORBIT  I MADAM 


PICK  system 


PICK  DATA  file 


SHCRV  INDEX  term 


FIND  topi c 


F I ND  AUTHOR  n ame 


FIND  a AND  b 


CCMBINE  SET  m 
AND  SET  n 


CCMBINE  SET  m 
OR  SET  n 


SHOW 


SHOW  TITLE 


SHOW  OFFLINE 


SHOW  SET  n 


SHOW  NEWS 


EXIT 


[logout/Iogin] 

* FILE  file  no . 


EXPAND  t e rm 


SELECT  topic 
SELECT  AU  = name 


SELECT  a (C)  b 


CCMBINE  m * n 


CCMBINE  m + n 


TYPE  x/2 


TYPE  x/6 


PRINT  x/2 


TYPE  n/2 


7NEWS 


LOGOFF 


[ logout/login] 
F I LE  file  n ame 


NEIGHBOR  t e rm 


FIND  topic 
FIND  name  (AU) 


FIND  a AND  b 


m AND  n 


m OR  n 


PRINT 


PRINT  TI 


OUTPUT  OFFLINE 


Sn /OUTPUT 


NEWS 


• STOP 


MADAM  / QUIT 


change  db 


(see  footnote ) 


topic 


SE  AU  = name 


SELECT  a AND  b 


SE  SET  m 
AND  SET  n 


SE  SET  m 
OR  SET  n 


DISPLAY 


DISPLAY  [ti] 


PRIhJT 


[on]  DIS.  [n] 


* db  [or]  sb 


QUIT 


Note:  Index  Browsing  exists  in  MADAM  as  Interface,  not  yet  fully 
imp  1 ement  ed  . 


TABLE  1 Comparison  Between  CONIT  and  Three  Other  Systems 
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4.2.5  The  Problems 

CXDNIT  has  demons  trated,  after  7 years  of  research  and  use, 
that  it  was  indeed  a successful  tool  in  helping  casual  users 
retrieve  relevant  information  from  different  databases,  and  CX)NIT 
did  so  without  causing  too  great  an  increase  of  time  online. 
However,  the  system  has  also  shown  some  difficulties  inherent  to 
such  an  approach:  some  are  clearly  due  to  the  implementors’ 
choices,  while  others  are  somewhat  accidental;  these  points  will 
be  presented  and  analyzed  here. 

The  problems  with  CXDNIT,  at  least  CONIT  such  as  described  by 
the  literature  available  to  the  author  of  this  review,  come 
mainly  from  the  imperfection  of  the  translation.  The  question  of 
” h ow  exact  mu st  a translation  be?”  is  one  wh ich  can  be  argued  for 
quite  a long  time,  because,  just  like  for  human  languages,  a 


perfect 

translation 

is  probably  impo  s s i b 1 e 

to  obtain. 

So  , 

"how 

good  is 

good  enough?" 

is  up  to  the  designers 

to  decide. 

But 

the 

following  points  are  worth  noting: 

( 1 ) By  s imp lifying  the  1 anguage , many  valuable  options 
have  been  lost  from  the  original,  - even  if  those 
options  were  available  in  ALL  of  the  original  systems. 
For  example,  the  systems  retained  by  CONIT  all  have 
the  capacities  of  ”Search  History”,  and  to  repeat  on 
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equivalent  search  on  different  databases,  but  CONIT 
does  not  allow  those  facilities. 

(2)  Some  particularities  of  systems  have  been  preserved, 
which  is  clearly  a choice  of  the  designers.  But  the 
global  view  of  the  virtual  system  suffers  from  such 
except! ons . 

— > PICK  DATA  FILE 

is  a number  in  DIALOG  (for  .FILE  FILE  no),  but  a name 
for  ORBIT  (for  FILE  FILE  NAME). 

An  other  ex  amp  1 e i s • t h e . . 

— > SHOWING  NEWS 

which  is  not  sufficient  for  all  systems.  Thus,  for 
the  MEDLINE  news,  the  following  is  needed: 

— > PICK  NLM  NEWS 

Of  course,  there  are  many  difficulties  in  constructing 
a consistent  translation,  and  this  paper  points  only 
to  those  weaknesses,  even  if  reasons  are  recognized. 
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4.2.6  CONIT  Conclusion 

In  conclusion,  CONIT  has  clearly  shown  that  it  was  possible 
for  a computer  intermediary  system,  to  assist  users  with  no 
previous  experience,  in  retrieving  information  from  dozens  of 
heterogeneous  databases,  coming  from  4 different  systems.  It  has 
also  proved  to  be  a useful  tool,  and  a valuable  help  to  casual 
users;  however,  its  efficiency  and  performance  are  clearly 
inferior  to  ’’the  retrieval  effectiveness  achievable  by  expert 
human  intermediaries  working  in  conjunction  with  the  end  user”, 
as  Marcus  himself  puts  it  [Marcus,  81].  The  question  of  ”how 
exact  a translation  should  be”  remains,  and  it  is  one  which 
become  more  important  all  the  time,  with  natural  languages  being 
studied  mo  re  intensely. 

4.3  I IDA 

An  exeunp  1 e of  a c ompu  t e r sy  s t em  serving  as  inte  rmed  i ary 
between  a user  of  online  bibliographic  systems  and  the  system 
itself,  is  the  I IDA  (Individualized  Instruction  for  Data  Access). 

4.3.1  Presentation 

I IDA  has  been  developed  at  Drexel  Uni ve rsity,  with  the 
financial  help  of  the  National  Science  Foundation.  Professor 
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Charles  T.  Meadow  started  the  project  in  1976.  The  Software  used 
in  IIDA,  is  a direct  descendant  of  MIT’s  CONIT  and  Caruso’s 
TRAINER,  both  already  described.  The  MULTICS  system  is  the 
computing  environment  used  for  the  project,  and  the  Data  Base 
Search  System  is  Lockeed  DIALOG  System. 

4.3.2  Study  of  IIDA 

The  IIDA  was  designed  to  offer  online  instruction  and 
assistance  to  casual  users  of  bibliographic  database  syst  ems  . 
Th is  extensive  help  is  available  to  the  relatively  inexperienced 
searcher  without  human  intervention.  I IDA  offers  the  ex  amp  1 e of 
a system  where  major  procedural  errors  are  detected  by  the 
computer,  and  where  inexperienced  searchers  are  offered 
assistance  in  order  to  complete  their  searches.  This  kind  of 
intermediary  facility  is  known  as  an  "expert  system.” 

4.3.3  Two  Modes  Available 

IIDA  is  an  interface  lying  between  the  terminal  of  the 
searcher  and  the  retrieval  system  of  the  search  service,  (l) 
IIDA  acts  as  a "screen,”  and  provides  instructions  and  diagnostic 
capabilities.  That  is,  it  will  monitor  the  user-system  exchange. 


(l)  At  this  time,  Lockeed’s  DIALOG  is  the  retrieval  system  used 
by  IIDA. 
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it  will  keep  track  of  all  data  transfers,  record  history  and 
perform  analysis  of  each  and  every  search.  It  will  also  give  all 
this  information  to  the  user,  if  requested  to  do  so.  In  some 
cases,  I lOA  will  even  take  the  lead,  and  signal  to  the  user  some 
errors,  inconsistency  or  messages  related  to  the  state  of  the 
system  (errors,  disconnection,  line  over-use,  shut  down  ...) 

IIDA  works  in  two  distinct  modes,  which  the  user  will  select 
himself:  the  "exercise  mode”  and  the  "ass i stance  mode” . which 
are  explained  bel ow . 

Exercise  mode.  A first  time  user,  or  a user  who  has  not 
searched  for  quite  a long  time,  will  probably  favor  this  .type  of 
monitoring;  here,  IIDA  exercises  extensive  monitoring,  and  the 
user  is  closely  "watched”  by  the  system.  This  mode  is  to  be  used 
mainly  for  training,  and  for  improving  search  skills.  It  can  be 
described  as  an  introduction  to  the  comnands  and  to  the 
development  of  search  strategies. 

Three  different  types  of  exercises  compose  the  exercise 
mode.  The  user  has  the  choice  of  which  exercise  to  go  through. 
The  order  represents  an  order  of  increasing  difficulty.  During 
each  of  the  sections,  the  user  has  access  to  the  "help”  library. 

(l)  Exercise  lisa  "canned  exercise”.  The  user  answers 
IIDA  suggestions  (menu  driven  or  prompting).  This 
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way,  the  user  learn  the  ’’basics”  and  the  syntax  of  the 
language.  Each  presentation  of  a concept  is  followed 
by  examples  that  the  user  completes.  The  system  does 
not  intervene  if  the  answer  is  not  correct:  it  is  a 

very  basic  introduction  to  the  system,  but  enough  to 
get  started. 

(2)  Exercise  2,  which  uses  only  a subset  of  the  language, 

allows  limited  search  with  only:  BEGIN,  EXPAND, 

SELECT,  CQVIBINE,  PAGE  and  TYPE  which  were  introduced 
in  exercise  1.  The  search  is  also  restricted  in  its 
sequencing  (i.e.:  a combination  is  necessary  before 
any  output  can  take  place). 

(3)  Exercise  3 utilizes  the  full  language,  but  there  is 
still  a restriction  in  the  logical  sequencing  of  the 
instructions . 

Assistance  mo d e . Th e assistance  mo de  is  the  no rma  1 mo d e to 
be  used  when  performing  searches.  The  I IDA  monitoring  is  very 
discrete,  intervening  only  when  difficulties  appear,  or  when 
specifically  requested  by  the  user.  In  order  for  1 1 DA  to  perform 
its  counseling  role,  it  must  gather  enough  information  from  the 
search,  as  the  reader  will  see  below. 
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4.3.2  Information  Gathered 

During  the  exchange  between  the  user  and  the  system,  I IDA 
gathers  the  history  of  the  following  data: 

(1)  Comnand:  The  text  of  each  conmand  is  stored  as 

entered,  and  then  parsed,  in  order  to  have  each 
element  of  the  comnand  stored  as  independently 
addressable  data. 

(2)  Set:  All  sets  created  are  stored  (just  as  the  DI ALOG 

”ds  (display  set)”),  with  additional  pointers  and 
descriptors  wh  i c h all  ow  further  c omp  arisons.  Also, 

those  sets  are  clustered  according  to  similarity  of 
defining  terms  . 

(3)  Descriptor:  All  the  descriptors  used  in  search 

conxnands  are  present  in  a descriptor  table.  The 
descriptors  which  have  been  already  viewed  by  the 
users  are  specially  marked. 

(4)  Sets  retrieved:  A table  of  all  sets  viewed  is  also 
formed.  This  table  indicates  for  each  record 
retrieved,  its  relevance  and  its  ties  with  a set. 

(5)  Error:  Each  "ERROR”  is  noted  in  its  context,  and  thus 
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available  for  further  analysis. 

All  this  data  is  gathered  for  further  analysis  of  the 
u s e r — b e ha V i o r . For  the  sake  of  keeping  statistics  and  general 

system  evaluation,  IIDA  keeps  also  track  of  all  the  features 
searchers  use  on  the  system.  Mainly,  the  HELP  session  are  kept 
in  a separate  table. 

4.3.5  Monitoring  User’s  Activity 

As  was  said  earlier,  the  main  purpose  of  an  expert  system  is 
to  help  the  user  in  his  necessary  exchange  with  the  c omp  u t e r . 
Thus,  IIDA  will  monitor  this  conversation,  and  pick  up  some  (if 
not  all)  problems,  A list  of  most  of  the  categories  of  problems 
identified  by  IIDA  follows:  it  is  not  exhaustive,  but  represents 

the  framework  behind  such  a system, 

( 1 ) ERRORS : 

Syntactic  Errors:  such  as  invalid  conmands  or 

abbreviations,  invalid  characters,  bad  format  in 
conxnand,  invalid  operators,  parenthesis  missing  ... 

( 2 ) POOR  USAGE : 

(a)  Under  use  of  facilities: 

- Failure  to  EXPAND,  especially  after  creating 
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several  null  sets. 

- Failure  to  TYPE  or  DISPLAY  before  issuing  a 
PRINT  conmand,  or  format  not  correct. 

( b ) Ov er  use  of  facilities: 

- Excessive  TYPE 

- Excessive  EXPAND 

- Excessive  time  spent  in  between  conmands . 

(c)  Correct,  but  poor  use  of  facilities: 

- unnecessary  repetition  of  conmands. 

^Excessive”  null  set  generation. 

4.3.6  Diagnoses 

As  was  explained  above,  IIDA  will  "screen”  the  user's  input, 
and  diagnose  his  behavior.  There  exist  two  levels  of  such 
ana  lysis : 

(1)  At  the  first  level,  IIDA  will  recognize  a syntactic 
error,  that  is,  a query  that  DIALOG  would  not  be  able 
to  recognize.  The  query  is  not  sent,  and  the  users  is 
informed  by  IIDA  of  the  error. 

(2)  At  the  next  level,  IIDA  will  make  a further  analysis 
into  the  context  of  the  input:  for  example,  the 
strategy  used  during  the  search  is  observed,  and  if 
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"judged”  nonproductive  or  inefficient  by  the  system, 

\ 

lIDAwill  suggest  variations.  That  is,  I IDA  wi 1 1 take 
an  "intelligent  look"  at  a query  of  the  type: 
"Correct,  but  poor  use  of  facilities",  as  described 
above.  The  system,  once  it  has  recognized  the 
strategic  errors,  will  offer  some  solutions  in  order 
to  improve  performances. 

Here  we  can  see  that  IIDA  does  not  stop  its  services  by 
issuing  an  "error  message",  but  goes  one  step  further  by  giving 
advice,  indeed  a unique  approach.  Meadow  and  his  team  had  to 
define  first  what  a "good  strategy"  was.  From  this  definition, 
they  gave  rules  adaptable  to  the  system  [Meadow,  79b]. 

The  strategy  of  a typical  search  is  derived  from  Penniman’s 
cycle.  David  Penniman  in  his  Ph.D.  dissertation  [Penniman,  75] 
describes  one  cycle  as  a pattern  of  repetitive  commands  such  as: 
BEGIN,  EXPAND/ SELECT,  COMBINE  and  PRINT  in  that  order. 

The  number  of  each  step  varies,  according  to  numerous 
factors,  but  the  order  is  always  respected  within  a cycle.  If  a 
search  needs  more  than  one  cycle  for  completion,  the  set  of  "n" 
successive  cycles  determining  a search,  is  called  a string. 

All  the  diagnostic  capabilities  in  IIDA  are  based  upon  this 
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observation,  (l)  Most  of  the  errors  and  warnings  come  from  the 
observation  of  a broken  cycle  or  from  a cycle/string  going  over 
some  predefined  limits  (size  and  niunber). 

When  I IDA  receives  an  input,  it  first  determines  its 
validity.  If  the  syntax  is  found  correct  (that  is,  DIALCX5  would 
recognize  the  input  as  a valid  conxnand),  I IDA  takes  a look  at  the 
"strategy”  used.  A strategy  found  incorrect  or  inefficient  will 
generate  actions  from  the  Warning  Control  Program  (WCP),  an 
important  piece  of  software  within  the  system.  If  called,  the 
\WTP  will  take  one  of  the  following  actions: 

(1)  It  will  send  an  "error  message”  to  the  user.  In  the 

choice  of  wording.  Meadow’s  team  was  very  careful 
about  using  "neutral”  messages,  that  is,  messages 
which  would  not  adversely  strike  the  user.  Indeed,  an 
important  consideration  for  casual  users,  when  the 
reader  realizes  that  most  of  the  messages  by 
"computers”  are  accusatory:  the  user  did  something 

wrong.  Not  a "friendly  approach”! 

(2)  The  WCP  can  defer  the  message.  That  is,  if  the  user 
has  just  been  warned  of  some  actions,  and  he  repeats 


(1)  Further  developed  by  Oldrich  Standera  [Standera,  75]. 
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it,  I IDA  will  leave  him  alone.  It  is  hoped  that  the 
user  knows  what  he  is  doing.  The  first 
implementations  of  I IDA  were  going  further  in  this 
direction,  allowing  the  user  to  stop  messages  (type 
”/SLACJK”),  but  such  fancy  requests  are  far  from  the 
casual  users*  casual  needs. 

(3)  A message  can  also  be  suppressed.  For  example,  if  an 
error  generates  a set  of  errors,  only  the  **mo  s t 
important”  will  be  selected,  in  order  to  simplify  the 
corrective  action. 

(4)  A message  can  also  be  ”enhanced”,  that  is, 

complemented  with  relevant  information.  For  example, 
if  a message  has  been  deferred  ”n”  times,  and  finally 
released,  the  user  could  be  informed  that  the  message 
had  been  hidden  from  him  ”n”  times. 

Another  important  piece  of  software  is  the  ”help”  library 
already  mentioned.  It  allows  quick  advice  (type  ”QA” ) as  well  as 
return  to  the  exercise  sessions.  In  fact,  II DA  has  the  capacity 
of  moving  the  user  back  to  instruction  level,  if  it  is  judged 
needed . 
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4.3.7  I IDA  Conclusion 

In  this  short  presentation  of  II DA , the  author  of  this  paper 
has  tried  to  show  some  of  the  most  interesting  points  offered  by 
the  system.  The  reader  can  see  that  IIDA  presents  much 
originality.  However,  the  philosophy  behind  it,  as  well  as  many 
of  the  approaches  are  not  new.  On  the  contrary.  Meadow  obviously 
knew  how  to  advance  his  system  by  using  state— of~the— art  work: 
thus  Penniman’s  understanding  of  a cycle,  CONIT's  tables  and 
parsing,  as  well  as  Caruso’s  TRAINER,  all  have  been  used  to 
complete  this  remarkable  tool,  which  has  been  successfully  tested 
outside  of  "academia”,  by  EXXON  for  example  [Landsberg,  80]. 

4.4  CITE 

The  next  example  studied  in  this  paper  is  an  "Intelligent” 
approach  to  the  same  problem  of  a casual  user  wishing  to  access  a 
retrieval  system,  with  no  external  help. 

CITE  is  an  example  of  a system  which  can  be  (Queried  in 
everyday  English.  The  importance  of  such  work  can  not  be 
overemphasized,  because  if  the  efficiency  and  ease  of  use  of  such 
an  interface  can  be  demonstrated  and  extended  to  other  systems, 
casual  users  could  have  their  desires  becoming  reality. 
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4.4.1  Presentation 

Since  1978,  a user  can  access  the  National  Library  of 
Medicine's  MEDLINE  (Medical  Literature  Analysis  and  Retrieval 
Systems  Online),  using  a natural  language  approach.  The 

interface  which  allows  this  interesting  approach  is  known  as 
CITE,  for  "Correct  Information  Transfer  in  English".  Queries  are 
issued  by  the  users  under  the  original  form  of  English  sentences, 
paragraphs,  groups  (or  lists)  of  te  rms  or  phrases  wh  i c h are 
compared  to  the  set  of  titles,  abstracts  and  controlled 
vocabulary  of  the  system.  The  origin  of  CITE  starts  in  1978, 
with  Doszkocs*  designs  of  AID  (Associative  Interactive 
Dictionary),  which  allowed  users  to  search  the  large 
bibliographic  files  of  MEDLINE  and  TOXLINE,  using  queries  in 
natural  language.  CITE  evolved  from  this  original  approach 
[Do  s zkoc  s , 79 ] . 

In  designing  CITE,  special  attention  was  given  to  efficiency 
and  quick  response  time.  But,  above  all,  the  design  of  the 
language  had  to  follow  the  following  rules: 

(1)  Assume  that  the  user  has  no  familiarity  with  the 
sy s t em. 

(2)  Information  will  be  solicited  in  a natural  manner. 
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(3)  Try  to  prevent  "frustration”  on  the  part  of  the 

searcher  [Doszkocs,  79]. 

4.4.2  Study  of  CITE 

CITE  proceeds  by  realizing  a number  of  successive 

operations,  represented  in  Figure  1 (page  51). 

The  steps  are  as  follows: 

(1)  The  casual  user  enter  his  query  in  plain  English. 

(2)  The  system  recognizes  search  terms  in  the  incoming 

input  by  matching  the  incoming  string  with  a stopword 
list  of  600  words,  and  indexes  are  retrieved  by 

comparison  to  the  MEDLINE  inverted  file.  At  this 
point,  synonyms,  various  spellings  and  other 
variations  are  recognized,,  and  unified  under  the 
controlled  vocabulary  selection. 

(3)  The  search  terms  are  processed,  and  each  one  of  them 
is  assigned  a weight.  Pointers  are  adjusted  to  each 
reference,  in  order  to  minimize  the  processing  time, 
if  the  s ame  t e rm  is  called  again. 

(4)  The  user  gets  a display  of  a set  of  titles  with  a 


I NASA/ RECON- 4 


49 


I MAN/MACHINE  I 


I NASA  I 


I NASA  I 


weighted  value  of  terms. 

(5)  Relevance  feedback,  whe r e the  user  selects  the  titles 
which  he  found  relevant  to  his  search  from  the 
complete  set  of  titles  retrieved  is  employed. 

(6)  With  PRINT,  the  user  gets  a full  listing  of  the  titles 
he  is  retrieving,  and  thus  is  given  an  idea  of  the 
path  he  is  following. 

( 7 ) Mo  dification  of  the  query  in  light  of  the  it  ems  the 
user  has  judged  "relevant”  is  performed. 
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FIGURE  1 The  CITE  Cycle 
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4.4.3  CITE  Conclusion 

The  approach  of  CITE  is  quite  original.  It  is  however 
difficult  for  the  author  of  this  paper  to  really  judge  the  value 
of  such  an  interface,  because  of  the  lack  of  literature 
available.  For  example,  it  is  of  first  importance,  for  the 
critic,  to  have  an  idea  of  what  the  stoplist  looks  like,  as  well 
as  the  way  the  records  are  treated  once  they  have  been 
recogni zed . 

If  the  system  were  to  prove  successful,  nothing  stops  it 
f r om  further  expansion,  as  nothing  in  its  design  ma k e s it 
exclusively  designed  for  MEDLINE. 

4 . 5 CCL 

A S t anda  rd  for  Eurone  t-DIANE . a solution  which  seems 

important  consider  is  the  possibility  of  having  some  type  of  a 
"standard  language”  which  would  allow  retrieval  from  different 
systems.  If  this  Esperanto  of  Information  Systems  were  to  exist, 
the  casual  user  would  have  to  learn  only  one  language. 

4.5.1  Question  of  Standard 

The  problem  with  implementing  a standard  language  is 
certainly  not  technological:  it  has  already  been  done,  and  can 
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even  be  done  quite  efficiently.  The  most  famous  example,  so  far, 
is  the  Eurone t-DIANE  ’ s Conmon  Conmand  Language  (CCL) . 
Eurone t-DIANE  is  the  result  of  a European  effort  to  put  together 
the  wealth  in  information  of  the  different  European  countries: 
the  resulting  databases  would  also  gain  if  they  were  accessible 
through  a unified  language,  on  a single  network.  Many 
governmental  and  comnercial  organizations  have  accepted  the 
proposal.  Euronet  has  been  operational  since  1980.  In  1983,  5 
different  European  systems  had  accepted  to  implement  the  language 
CCL  on  their  individual  retrieval  systems.  They  often  choose  to 
utilize  ”front-end”  translators  to  modify  their  conmand 
languages,  instead  of  separate  computer  interfaces. 

4. 5,2  Presentation 

Unfortunately  all  that  CCL  has  from  ”Conmon”  is  the  first 
initial!  And  that  is  where  the  problem  of  standard  language 
resides:  those  5 systems  have  agreed  to  run  a ^conmon  language,” 
which,  after  only  2 years,  has  already  evolved  in  two  distinct 
subsets  (l)  [ Ve rhe i j en-Voogd , 81].  The  divergence  between  the 
two  languages  are  quite  small  (mainly  punctuation  and  use  of 
symbols),  but  it  is  certainly  enough  to  give  a bad  name  to 
”Comnon  Language”  and  headaches  to  the  casual  users. 

(1)  Those  2 languages  are  ”IRS/ESA”  and  ”DIMDI ” 
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4.5.3  Problems  in  Standard- 

How  Eurone t-DIANE  let  itself  be  cornered  in  such  a problem 
can  easily  be  explained  if  the  reader  agrees  to  consider  the 
following  points,  which  are  traditional  difficulties  in 
implementing  standards:  (l) 

(1)  A standard  will  always  be  AGAINST  current  or  past 
methods.  In  the  case  of  languages,  it  is  difficult  to 
convince  implementors  and  users  that  the  new  one  will 
be  better. 

(2)  A standard  is  difficult  to  sell  because  it  attacks 
some  economic  interests.  Neither  the  commercial  nor 
the  governmental  agencies  see  with  pleasure  the 
increased  workload  and  cost  resulting  from 
imp  1 ement i ng  s t andards  . 

(3)  How  can  one  be  convinced  which  one  is  "better”?  What 
is  better,  anyway?  Better  for  one  user,  does  not 
necessarily  means  better  for  all. 

(4)  The  size  and  advanced  state  of  the  current 

implementations  make  change  difficult. 

(l)  Reference  the  social  tragical  comedy  of  the  implementation  of 
metric  standards  in  the  US? 
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In  the  case  of  Euronet,  this  last  point  should  not  have 
counted,  but  the  other  interests  were  too  strong,  and  the 
"Conmunity”  now  has  at  least  2 new  languages  to  cope  with! 


5 . REMUNIM5  QUESTIONS 

So  far,  this  paper  has  shown  different  examples  of 
realizations  tending  to  simplify  the  access  of  retrieval  systems 
to  the  casual  users.  Of  course,  there  are  many  other  approaches 
possible.  In  the  following  pages,  the  reader  is  invited  to 
consider  some  aspects  of  the  problem  which  have  not  been 
mentioned  in  the  preceding  pages. 

5.1  New  Technology 

Studies  in  ma  n / ma  chine  interface  are  taking  increasing 
importance,  since  computer  comnuni cat i on  and  information  systems 
have  been  realized  which  not  only  seem  to  be  getting  increasingly 
more  economical,  but  also  more  reliable  and  more  responsive. 
This  section  is  going  to  survey  some  of  the  interesting  points 
which  are  being  developed,  and  could,  in  a near  future,  simplify 
the  casual  user’s  access  to  retrieval  systems. 
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5.1.1  Micro  Computers  and  Smart  Terminals 

It  is  an  easy  guess  to  predict  that  within  a near  future 
much  help  will  be  directly  given  by  the  user’s  micro-computer. 
Already  now,  it  is  possible  to  access  information  retrieval 
systems  through  intelligent  terminals  or  a micro-computer,  and 
have  those  tools  perform  many  redundant  and  annoying  tasks.  For 
example,  there  are  many  necessary  "housekeeping”  operations  which 
are  needed  to  access  a system;  it  is  necessary  for  the  user  to 
dial  a network,  issue  an  ID  number,  a password,  an  account 
number,  the  name  of  a database  and  a file  ...  All  these 
operations  are  cumbersome  and,  because  they  are  somewhat 
mechanical,  they  are  very  easily  performed  by  a computer. 

For  example,  a user  could  enter  his  name  on  his  micro  and 
call  his  favorite  online  system.  Assuming  that  the  modem  is  of 
the  "smart”  type  (l)  , the  user  will  have  to  wait  patiently  for 
the  connection  to  be  accomplished  through  the  network  to  the 
system  desired.  Thus,  it  can  be  seen  that  mi  c r o — comput e r s can 
take  care  of  the  login  procedures,  like  the  "Autocall”  previously 
described  did  for  CX)NIT’s  users.  It  makes  sense  to  go  one  step 
further,  and  propose  for  the  computer  to  allow  a selection  of 


(1)  Like  the  "Smartmodem”  from  Hayes,  these  modems  transform 
character  input  into  a phone  number,  and  dial  the  number  by 
thems  elves  . 
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system.  For  the  casual  user,  the  only  choice  remaining  would  be 
to  select  the  name  of  the  desired  system  out  of  a menu. 

Once  online  and  ready  to  start,  the  user  has  to  call  a 
database.  Some  systems  - like  DIALOG  - put  the  searcher,  upon 
entering  the  system,  within  a default  database;  but  the  micro 
could  easily,  as  a part  of  the  login  procedures,  call  a 
user-defined  default.  It  is  easy  to  imagine  that  the  micro  could 
insure  some  kind  of  interfacing,  and  help  the  casual  user:  in 
other  word,  a micro- 1 IDA! 

Goldstein  has  shown  [Goldstein,  78]  how  an  interface  could 
simplify  the  searching  of  a particular  database  (CATLINE)  of  a 
particular  system  (MEDLINE),  by  replacing  the  system  language 
with  a simpler  one.  His  remarks  can  easily  be  generalized  to 
other  systems  and  other  databases.  Indeed,  as  this  paper  has 
previously  shown,  it  would  be  interesting  to  implement  some  kind 
of  "translators,”  where  a user  would  be  allowed  to  enter  queries 
for  any  systems,  using  the  system  language  he  knows  the  best!  (l) 

The  interface  could  also  easily  store  repetitive  queries  and 
generate  those  streams  upon  requests.  These  mechanisms  are  now 
available  in  most  systems.  They  can  be  implemented  by  the 
interface,  giving  the  casual  user  an  important  advantage:  he 


(1)  For  example,  accessing  DIALCXJ,  using  ORBIT’s  queries 
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would  have  all  the  time  he  needs  to  build  his  queries  and  he 
would  get  to  know  ”his”  interface.  Knowing  the  interface  in  this 
case  could  be  more  important  than  knowing  the  systems,  since  the 
queries  would  be  directed  to  the  interface. 

Finally,  and  the  most  important  point,  the  interface  could 
^capture”  the  output.  Instead  of  having  the  cycle: 

Retrieve,  Check,  Print,  Retrieve,  Check,  Print,  Retrieve  ... 

until  c omp  letion,  or  searcher  exhaustion,  a user’s  station  could 
capture  the  data,  copy  the  output  into  its  memory  (diskettes), 
and  logoff.  At  this  point,  all  the  data  is  available  to  the  user 
and  ready  for  further  processing.  When  the  user  is  offline,  he 
does  not  have  the  time  pressure  mentioned  above.  He  will  be  able 
to  edit,  format,  clean— up  and  select  his  output  at  his  own 
convenience.  If  more  information  is  needed,  the  user  can  renew 
the  process.  Note  also  that  the  exchange  can  easily  be  performed 
at  1200  baud  or  faster,  instead  of  a slower  output,  required  by 
reading  onl ine . 

Another  possibility  is  for  the  interface  to  transform  the 
data.  For  example,  a query  to  a database  can  give  some  output 
which  the  user  would  like  to  use  as  input  for  further  queries. 
This  transformation  process  could  be  realized  by  the  interface. 


I DBMS.  NASA/ RECON- 4 I 


58 


I MAN/M\CHINE  I 


I N A S A I 


I N A S A I 


with  the  double  advantage  that  omissions  and  typographical  errors 
are  eliminated:  all  of  the  output  can  be  transformed,  and  appear 
as  a s t r e am , in  the  s ame  sequence  as  the  output. 

5.1.2  Graphics  Interface 

Even  if  it  is  not  of  first  importance,  as  far  as  data 
retrieval  is  concerned,  a report  about  man/machine  interfaces  can 
not  be  complete  without  a mention  of  graphical  support.  The 

exchange  between  user  and  machine  has  so  far  been  restricted  to 
conceptual  and  linguistic  rules.  However,  the  realization  of 
such  system  as  the  LISA  from  Apple  has  shown  the  way  toward  new 
appr oache  s . 

Without  pretending  to  judge  the  effectiveness  or  the 
necessity  of  such  realization,  the  reader  is  invited  to  recognize 
the  following  trends,  which  are  very  likely  to  be  further 
developed  in  the  near  future: 

(1)  The  concept  of  a user  pointing  to  an  image,  a 
graphical  representation  of  a concept  instead  of 
formulating  rigid  and/or  lengthy  queries. 

(2)  The  reduction  of  the  amount  of  wordy  dialogues:  fewer 

terms  for  the  user  to  memorize,  type  and  correct. 
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(3)  Repetitive  queries  are  widely  used:  the  user  is 

invited  to  transform  existing  modules  instead  of 
creating  new  dialogues  from  scratch. 

All  these  attempts  can  help  the  casual  user  feel  more 
c omf ortable  in  his  search. 

5.1.3  Other  Ways 

There  exist  many  other  examples  of  potential  research, 
however,  not  at  all  necessarily  applicable  to  data  retrieval. 
The  idea  of  moving  a pointer  across  a screen  in  order  to 
pin-point  or  select  one  item  from  a menu  is  certainly  beneficial 
to  the  casual  user.  Th e ”mo use”  wh ich  helps  the  user  in  his  path 
finding  is  also  an  issue  which  is  well  accepted,  at  least  by  the 
manufacturers...  There  are  many  other  examples  of  new  ideas:  the 

US  Air  Force,  for  example,  has  equipped  many  of  its  bombers  with 
devices  on  which  the  focusing  of  the  pilot’s  eyes  is  translated 
into  targets  for  its  bombs...  Thus  the  pilot’s  role  is  simplified 
to  the  visual  selection  from  a screen. 

5 . 2 Co s t Factor 

By  building  an  interface,  that  is,  by  adding  a new  step  to 
the  process  of  retrieving  data,  a new  factor  is  involved:  the 
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cost  factor.  By  this  remark,  reference  is  not  only  made  to  the 
cost  of  developing  an  interface,  but  also,  the  cost  of  executing 
i t . 

5.2.1  De ve 1 opment  Cost 

To  be  considered  are  the  cost  of  writing  the  software, 
building  the  necessary  hardware  (like  "friendly  terminals"),  the 
necessary  extra  storage  (l)  and  the  fact  that  the  c omnun i c a t i on 
needs  are  often  somewhat  higher,  sometimes  doubled,  since  the 
c onmu nication  is  now  not  only  between  the  user  and  the  system, 
but  between  the  user,  the  interface  and  the  system.  Also,  by 
using  an  interface,  many  steps  risk  to  be  duplicated  (i.e. 
parsing  of  comnands , translation  or  interpretation  of  comnands 
and  messages,  etc.). 

Finally,  if  any  "accessories"  are  used  in  order  to  help  the 
user,  such  as  a mouse  or  graphics,  their  cost  will  increase  the 
global  price  for  the  user. 

5-2-2  Usage  Cos  t 

On  the  other  hand,  the  utilization  of  an  interface  can  save 
a good  amount  of  money,  if  the  reader  accepts  the  following 


(1)  For  example.  CONIT  3 requires  at  least  200K  of  storage. 
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points* 

First,  the  original  idea  behind  an  interface  was  to 
eliminate,  or  at  least  to  reduce  the  need  of  the  professional 
searcher:  an  important  savings  on  the  payroll.  Also,  if  the  need 
for  formal  training  can  be  diminished,  and  if  the  casual  user  can 
get  a substantial  satisfaction  from  the  system,  the  interface  can 
justify  its  role*.  It  is  the  opinion  of  the  author  of  this  paper 
that  if  a user  is  satisfied  by  his  search,  he  will  use  the  search 
process  more  and  more.  By  augmenting  the  usage,  it  is  thought 
that  the  per-usage  price  of  using  retrieval  systems  will  go  down. 
Finally,  it  seems  probable  that,  in  the  future,  users  of 
commercial  systems  will  be  billed  not  only  for  the  time  spent 
online,  but  also,  or  only,  for  the  "usage  time"  (CPU  time).  This 
mode  seems  more  "fair",  and  will  probably  appear  in  a near 
future.  If,  and  when,  this  type  of  billing  is  installed,  the 
casual  user  will  get  some  financial  advantages  in  using 
’’counseling  systems"  such  as  IIDA. 

5.3  P r o b 1 ems 

Finally,  the  creation  of  an  interface  brings  some  problems 
which  deserve  further  study.  This  paper  has  already  noted  the 
difficulties  encountered  by  CONIT*  which  offers  one  interface  for 
many  classes  of  systems.  An  interface  designed  for  one  class  of 
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user  encounters  the  same  problems,  mainly  because  individual 
needs  are  different.  An  interface  should  be  easily 
” by-pa s s a b 1 e ” . Also,  the  question  of  defining  ”how  complete^  or 
” h o w c omp rehensive”  an  interface  should  be,  is  a very  difficult 
one  to  answer.  By  being  absolutely  perfect,  and  covering  all 
cases,  an  interface  runs  the  risk  of  being  too  slow  for  any  user. 

Other  points  worth  considering  are  the  facts  that  there 
exist  some  exceptional  cases  which  are  very  important  for  a 
casual  user,  but  so  far  have  not  been  covered  by  any  of  the 
studies  researched  in  this  paper.  Thus,  if,  during  a search,  a 
system  failure  occurs,  it  is  likely  that  the  casual  user  will  be 
at  a loss.  The  naive  searcher  is,  without  any  doubts,  going  to 
think  he  did  something  wrong.  And  now  what  to  do?  That  is  a 
kind  of  traumatic  experience  which  is  worth  being  cured,  before 
the  user  turns  his  back  away  from  the  retrieval  process. 


6 . SlMvlARY 

This  paper  has  studied  some  options  available,  in  order  to 
let  casual  users  access  multiple  online  retrieval  systems  with 
minimum  difficulties. 

One  of  the  advantages  of  such  an  interface  is  that 
experimental  research  can  (easily)  be  implemented  at  the 
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interface  level.  It  is  even  possible  to  push  the  idea  one  step 
further,  and  recognize  that  mod ifications  and  enhanc  emen  t s of  a 
retrieval  system  can  be  studied  using  the  interface.  The  changes 
could  be  observed  and  tested  on  the  interface  as  long  as  needed, 
and  implemented  on  the  main  system  only  when  fully  satisfactory. 

Users  are  very  different  in  their  needs,  their  behavior  and 
their  intellectual  capacities,  but  the  interface  mu st  be  able  to 
handle  all  of  them.  Thus: 

(1)  The  interface  should  be  prepared  to  cope  with  any  type 
of  mistakes  or  any  possible  succession  of  mistakes. 

(2)  Help  should  be  available  wh en  necessary  in  precise  and 
brief  di splays . 

(3)  Users  should  be  able  to  ”fall  back  on  their  feet” 
after  any  important  decision.  For  example,  the  system 
should  come  back  to  ask  for  confirmation  before 
accepting  any  drastic  changes. 

It  is  important  to  keep  in  mind  that  users  are  human  beings, 
and  their  expectations  and  their  reactions  should  be  well 
understood.  For  example,  if  the  system  is  perceived  once  as 
unfriendly  or  difficult  to  use,  it  is  very  unlikely  that  the  user 
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will  c ome  back  to  it,  unless  obliged  to  do  so.  As  Lancaster  puts 
it:  ’It  is  all  too  easy  for  the  inexperienced  user  to  bee  ome 
frustrated,  and  the  once~f rustrated  user  tends  not  to  return  to 
the  system’  [Lancaster,  72], 

It  is  the  problem  that  the  1980’s  are  facing:  the 
availability  of  technology  is  a great  thing,  if,  and  only  if,  it 
can  be  used  by  the  people  who  need  it.  And  that  is  a challenge 
which  must  be  met  with  no  delay. 
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ABSTRACT 

It  is  only  recently  that  research  in  artificial  intelligence 
(AI ) is  accomplishing  practical  results.  Most  of  these  results 
can  be  attributed  to  the  design  and  use  of  expert  systems  (or 
Knowl e dg e -Ba s e d Systems,  KBS)  — problem  solving  computer  programs 
that  can  reach  a level  of  performance  comparable  to  that  of  a 
human  expert  in  some  specialized  problem  domain.  But  many 
computer  systems  designed  to  see  images,  hear  sounds  and 
recognize  speech  are  still  in  fairly  early  stage  of  develo pme n t . 

In  this  report,  a preliminary  survey  of  recent  work  in  KBSs 
is  reported,  explaining  KBS  concepts  and  issues  and  techniques 
used  to  construct  KBS.  Application  considerations  to  construct 
KBSs  and  potential  research  areas  in  KBSs  are  identified.  A case 
study  (M5fCIN)  of  a KBS  is  also  provided. 
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section  titles  within  the  report  are  followed  inxnediately  by 
cited  references  indicating  that  credit  for  the  contents  of  the 
entire  section  is  due  to  the  cited  author(s). 
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KNOLEDGE  BASED  SYSTEMS  : 

A PRELIMINARY  SURVEY 
OF 

SELECTED  ISSUES  AND  TECHNIQUES 


1 , INTRODUCTION 

It  is  only  recently  that  artificial  intelligence  (AI ) - that 
branch  of  computer  science  that  attempts  to  have  machines  emulate 
intelligent  behavior  - is  acc omp lishing  practical  results.  Mo s t 
of  these  results  can  be  attributed  to  the  design  and  use  of 
expert  systems  (or  Knowledge-Based  Systems,  KBS)  - problem 
solving  computer  programs  that  can  reach  a level  of  performance 
comparable  to  that  of  a human  expert  in  some  specialized  problem 
domain  [Nau,  83]. 

This  project  report  surveys  recent  work  in  KBS,  explaining 
KBS  concepts  and  issues. 


2.  KNCMLEDGE-BASED  SYSTEMS  (KBS) 

It  is  necessary  to  distinguish,  at  the  outset,  between 
knowl  e dg e — ba s e d systems  and  other  computer-based  systems  that 
contain  or  incorporate  knowledge.  Almost  all  computer  programs 
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and  systems  contain  knowledge  of  at  least  two  kinds:  knowledge 
about  things  and  knowledge  about  what  to  do  with  things  - that 
is,  how  to  manipulate  or  transform  them.  Davis  [Davis,  77] 
defines  the  KBS  in  the  following  way:  ’A  knowledge-based  system 
is  one  in  which  knowledge  is  collected  in  one  or  more 
■Compartments  (called  knowledge  sources)  and  is  of  the  kind  that 
facilitates  problem  solving  (reasoning)  in  a single, 
well-defined  problem  domain.* 

Problems  are  solved  by  applying  the  kind  of  reasoning  that 
is  used  by  a practitioner  in  the  domain  in  which  KBS  is  applied. 
Unlike  generalized  problem  solving  system,  KBS  must  accumulate 
large  amounts  of  knowledge  in  a specific  domain  and  rely  on 
doma  in- s pe c i f i c problem  solving  techniques  that  can  be  developed 
to  a high  level  of  expertise  [Davis,  77]. 

In  building  such  systems,  researchers  have  found  that 
amassing  a large  amount  of  data  rather  than  sophisticated 
reasoning  techniques  is  responsible  for  most  of  the  power  of  the 
system.  Such  expert  systems,  previously  limited  to  academic 
research  projects,  are  beginning  to  enter  the  software  market 
place  [Gevarter,  83].  Some  of  the  application  areas  where  KBS 
are  used  are : 
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(1)  Medical  diagnosis. 

(2)  Mineral  exploration. 

(3)  Oil  -well  log  interpretation. 

(4)  Chemi  cal  and  biological  synthesis. 

(5)  Military  threat  assessment. 

(6)  Planning  and  scheduling. 

(7)  Signal  interpretation. 

(8)  Air-traffic  control. 

(9)  VLSI  design. 

(10)  Equipment  fault  diagnosis. 

(11)  Speech  understanding. 

(12)  Space  defence. 

(13)  Kfi  access  and  management. 

Table  2-1,  taken  from  [Nau,  83],  lists  few  of  the  existing 
systems  developed  for  some  problem  areas.  More  extensive  lists 
can  be  found  in  [Gevarter,  83]. 
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In  addition  to  these  systems,  some  compiler  languages  are 
being  developed  to  provide  tools  for  creating  knowledge-based 
systems:  AGE  [Ni  i , 79],  ARS  [Stallman,  77],  KRL  [Bobrow,  77],  OPS 
[Forgy,  77]. 

Speech-understanding  systems  developed  at  CMLJ  (eimong  other 
places)  are  not  included  in  this  survey  [Stefik,  77;  Reddy,  73; 
Reddy,  75].  This  is  because  they  are  more  complex  and  more  of 
research  prototypes,  yet  many  of  the  techniques  they  embody  are 
incorporated  in  systems  discussed  in  this  report. 


I DBMS  .NASA/ RECON- 5 I 


8 


I KNOVLEDGE-BASED  I 


I NASA  I 


I N A S A I 


Table  2-1  SOME  EXISTING  EXPERT  SYSTEMS  [Nau,  83] 


SYSTEM 

EXPERTISE 

AQl 

Diagnosis  of  Plant  Diseases 

CASNET 

Medical  Consulting 

DENDRAL 

Hy  pothesizing  Mo  lecular  Structure 
f r om  Ma ss  Spectrogr ams 

DIPMETER  ADVISOR 

Oi  1 Exp  1 or a t i on 

EL 

Analyzing  Electrical  Circuits 

INTERNIST 

Medi cal  Consul  ting 

KMS 

Med i cal  Con  suiting 

MACSYMA 

Mathematical  Formula  Manipulation 

MDX 

Medi cal  Consulting 

NDLGEN 

Planning  DNA  Experiments 

MYCIN 

Medcial  Consulting 

PROSPECTOR 

Mine  r a 1 Exp loration 

PUFF 

Medi cal  Consul  ting 

R1 

Computer  Configuration 
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Before  we  go  to  next  section,  I think  it’s  appropriate  to 
’’define”  knowledge.  The  following  is  taken  from  [Wiederhold, 
84].  Widerhold  observes  that: 

(1)  Knowledge  considers  general  aspects  of  data. 

(2)  Knowledge  is  significantly  smaller  than  data. 

(3)  Knowledge  does  not  vary  rapidly  (compared  to  data). 

Widerhold  gives  some  simple  examples  to  illustrate  the 
difference  between  knowledge  and  data: 


Mr.  Lee’s  age  is  43  years 
Mi ddle-age  is  35  to  50 


People  of  middle-age  are  careful 


Mr.  Lee  has  never  had  a traffic  accident 


- Data 

- Knowledge 

- Knowledge 

- Da  t a 
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2.1  A Hypothetical  KBS 

The  following  is  a brief  description  and  example  of  a 
simple,  hypothetical  KBS  application  that  illustrates  most  of  the 
capabilities  of  a KB  s y s t em . Th is  is  mo  stly  based  on  [ Da  vis,  77], 

The  hypothetical  system  is  an  automotive  service  consultant 
whose  primary  purpose  is  to  help  ensure  the  best  service  at  the 
least  cost  for  aut omo biles  brought  to  a service  agency.  Th e 
system  is  to  be  used  both  by  the  service  representative,  who  is 
the  primary  interface  between  the  customers  and  the  company,  and 
by  the  mechanics  who  work  on  the  cars.  . Although  the  reasoning 
skills  required  by  such  a KB  system  are  relatively  simple,  the 
amount  of  khQWl  gdgff  required  (exclusive  of  the  normal  data 
base)  is  large  because  of  the  number  and  variety  of  automotive 
subsystems  involved  and  the  high  degree  of  their  interdependence. 

The  data  base  of  the  system  would  contain  a description  of 
each  car  serviced  at  the  agency.  The  description  would  contain 
the  configuration  of  the  vehicle's  engine,  running  gear,  and 
optional  and  special  equipment  as  well  as  the  year  of 
manufacture,  model,  color,  service  history,  etc. 

The  system  would  contain  two  basic  kinds  of  knowledge: 
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(1)  Generic  knowledge  about  the  major  elements  of  the 
vehicle  (such  as  its  cooling,  ignition,  and  fuel 
sy s t ems  ) . 

(2)  Knowledge  about  the  model  and  its  specific  options* 

Diagnostic  knowledge  would  be  necessary  to  relate  symptoms 
to  causes  and  to  relate  specific  knowledge  to  generic  knowledge* 
For  instance,  poor  engine  performance  could  result  from 
mechanical  problems  (valves,  rings)  or  from  related  systems 
(cooling,  ignition,  or  carburet  ion) . 

The  intent  of  the  system  is  to  recomnend: 

(1)  The  least  expansive  tests  that  will  produce  the 
greatest  amount  of  specific  information  about  the 
cause  of  the  problem* 

(2)  The  least  expensive  repairs  for  the  problem. 

(3)  The  best  post-repair  testing  to  verify  that  the 
problem  is  solved. 

The  following  is  a hypothetical  scenario  of  such  a system  in 
operation.  The  users  are  the  service  representative  and  the 
mechanic(s)  performing  the  test  and  repair  work*  The  user 


I DH4S. NASA/ RECON- 5 I 


12 


1 KNCWLEDGE-BASED  I 


I N A S A I 


I N A S A I 


language  is  a stylized  English  designed  to  convey  a maximum 
amount  of  information  between  the  user  and  the  system  with  a 
minimum  amount  of  effort. 

■Sys  t gm:  Tuesday,  May  3,  1977,  08:32:44 

Service  rep : Next  customer 

System:  Enter  owner’s  n^une  or  vehicle  ID  number 

Service  rep : 1743  HBAQ  8197 

■Sj.stcm:  Owner  is  S.B.  Franklin,  car  is  1974  Ford  Gran 

Torino  d^dr  sedan  with  351-2V  engine,  A/C,  P/S, 
P/B  and  CA  smog  controls.  Last  service  — April 
4,  1977  at  28,412  mi  R&R  water  pump  and  lower 

radiator  hose,  what  is  present  mileage? 

Service  r ep : 29285 

Sy s t em:  Please  inform  owner  that  the  following  regular 

maintenance  services  are  due: 

Change  oil  and  filter  - last  changed  on  Jan  13, 
1977  at  24,842  mi  . 

May  we  be  of  other  service? 
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Service 

System: 
Service 
■Sys  t cm: 

Service 
Sys  t em; 

Service 

System: 

Service 

System: 


r ep : Battery  not  keeping  charge,  barely  able  to 
start  car  this  a .m. 

Any  other  symptoms  or  problems? 

r ep : No 

Check  belt  tension  on  alternator  - most  likely 
cause. 

rep:  WTiy? 

Last  service  required  removal  of  fan  and  belts, 
very  likely  that  tension  was  not  properly  set 
on  r e ins t a 1 1 a t i on . 

r ep : More  (meaning  more  things  to  be  checked  or 
tested) 

Check  fluid  level  in  battery  - next  most  likely 
cause  - overcharged  battery.  If  level  is  low, 
check  alternator  output  and  voltage  regulator. 

r ep : Replace  battery? 

No,  battery  is  6 mos  old  and  should  take 
recharge . 
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Service  rep:  Thank  you.  (Signal  to  system  that  session  is 
ended  for  now) 

^.y  $ t cm  I Car  assigned  number  287  in  control  system. 

First  test  to  be  performed  by  J.K.  Uzzi  in  Bay 
17  . 

After  the  car  is  moved  to  the  mechanic’s  work  area  and  the 
prescribed  tests  are  performed,  the  following  interchange 
takes  place  between  the  mechanic  an^l  the  system: 


Mb C h 9 h i c : JKU  17,  287  (indicating  mechanic,  bay  and  car 

being  serviced) 


Sys  t biro*  1974  Gran  Torino,  test  results  please. 

Mbghbnic : Belt  tension  OK,  battery  level  OK,  charge  low, 

alternator,  VR  output  OK.  Problem  not  found. 


5ystbm»  Test  for  above-normal  current  flow  with 

ignition  off.  (Mechanic  attaches  amneter  and 
take s reading ) . 


Mechani c : Reading  above  normal. 


Sys  tcm-  Check  for  faulty  switch  in  hood  light,  trunk 

light,  and  courtesy  lights. 
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Mechanic  finds  faulty  switch  in  trunk  light  such  that  light 

never  turns  off. 

Me c h a n i c : Fault  trunk  light  switch  R&R.  Current  reading 

norma  1 . 

What  specific  knowledge  must  such  a system  incorporate  in 
order  to  diagnose  and  suggest  remedies?  The  knowledge  must  come 
from  experts  who  have  acquired  and  demonstrated  diagnostic 
skills.  For  the  system  to  have  suggested  checking  the  belt 
tension  of  the  alternator,  it  would  have  to  know  that  the  earlier 
removal  of  the  belt  could  be  related  to  the  present  problem,  that 
the  severity  of  the  problem  would  depend  on  how  poorly  the 
tension  was  adjusted,  and  that  one  month  and  about  900  miles 
before  appearance  of  symptoms  (battery  failure)  is  not 
unreasonable.  Since  it  is  a highly  probable  cause  and  the 
easiest  to  test,  it  ranks  as  the  first  suggestion.  By  requesting 
more  information,  the  service  representative  can  tell  the  owner 
what  else  may  be  required  and  what  will  not  likely  be  required, 
such  as  a new  battery. 

Even  though  this  is  an  hypothetical  system,  functionally  it 
is  similar  to  many  successful  KB  systems  existing  today.  Of 
course,  those  systems  solve  more  difficult  problems  in  the  sense 
that  the  reasoning  chains  may  be  longer.  The  knowledge,  however. 
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is  of  a similar  variety,  and  the  interactive  discourse  has  the 
same  flavor  of  naturalness. 

2.2  KBS  Components 

A knowledge-based  system  is  one  that  supports  practitioners 
in  a specific  knowledge  domain  by  incorporating  the  knowledge 


acquired 

f r om 

experts 

in  that 

d oma  i n 

and 

applying  i t , 

in 

combination  with 

certain 

reasoning 

skills. 

to 

the  solution 

of 

pr ob 1 ems 

posed 

by  the 

practitioners. 

In 

other  words  , a 

KBS 

functions  as  an  intelligent  assistant  - a substitute  for  the 
expert  human  consultant  who  may  be  needed  but  unavailable.  A KBS 
may  produce  solutions  or  explanations  that  are  more  thorough  than 
those  produced  by  a human  expert,  and  may  produce  them  more 
rapidly  [Gevarter,  83].  However,  the  human  has  imagination  and 
the  capacity  for  innovation  which  even  the  most  expert  KBS  does 
no  t have . 

A KBS  is  composed  of  three  components  or  modules: 

( 1 ) An  interface . 

(2)  A cognitive  engine. 

(3)  A knowledge  base  (Figure  2-1). 
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The  knowledge  base  - the  passive  element  in  the  system 
contains  the  knowledge  sources  and  fact  files. 

The  cognitive  engine  drives  the  system.  It  performs  the 
system’s  problem  solving  (inference-making  or  reasoning) 
operations.  It  applies  the  knowledge  in  the  knowledge  sources  and 
uses  the  fact  files  in  the  knowledge  base  to  answer  questions  or 
solve  the  problem  posed  by  the  user. 

The  interface  provides  interactive  c oiiinun  i c a t i on  between  the 
user  and  the  system.  It  allows  for  the  acquisition  of  data  in  a 
variety  of  forms  - a real-time  signal,  a file  of  observations, 
data  provided  by  the  user,  etc,  and  for  the  addition  or 
modification  of  knowledge  in  the  knowledge  base. 

As  already  mentioned  above,  a KBS  acts  as  a special-purpose 
"intelligent  agent"  on  behalf  of  its  user;  it  is  not  a 
general-purpose  problem  solver.  It  provides  supportive  knowledge 
iu  a well-defined,  clearly  bounded  problem  domain.  No 
present-day  KBS  is  intended  for  use  by  a casual,  inexpert  user. 
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2.3  Knowledge  Base 

As  already  mentioned,  the  Knowledge  Base  (KB)  is  a passive 
element  of  KBS.  Though  passive,  the  KB  determines  the 
performance  and  utility  of  the  KBS,  because  the  Cognitive  Engine 
(CE)  (see  Section  2.4)  depends  on  the  knowledge  in  the  KB.  In 
this  section,  the  characteristics  of  the  KB  that  are  c onxno n to 
many  of  the  KB  systems  (that  I studied)  are  described. 

The  KB  of  a KBS  may  contain  both  Knowledge  Sources  (KSs)  and 
fact  files.  The  fact  files  that  are  contained  in  a KB  are 
equivalent  to  a data  base  in  that  they  contain  attribute  values 
and  the  equivalent  type  of  information  that  may  be  required  for 
the  complete  solution  of  a problem.  A collection  of  fact  files 
without  a Knowledge  Source  is  not  a KB.  A Management  Information 
System  constructed  from  a conventional  data-management  system  is 
not  a KBS  because  it  does  not  have  reasoning  or  inferencing 
capab i 1 i ty . 

A KS  contains  what  is  usually  called  knowledge.  Multiple 
KSs  are  usually  necessary  when  there  are  multiple  "levels”  of 
knowledge,  such  as  probl em-spe c i f i c knowledge  and  knowledge 
(often  called  Meta-knowledge)  about  how  the  CE  can  best  use  the 
problem-specific  knowledge.  Since  the  two  kinds  of  knowledge  are 
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used  for  different  purposes,  it  is  reasonable  to  keep  them  in 
different  KS s . It  is  also  often  true  that  more  than  one  kind  of 
prob 1 em- spe c i f i c knowledge  is  acquired  f rom  di f f erent  experts  and 
that  there  is  no  efficient  single  method  for  representing  all  of 
the  knowl  edge.  Since  different  representations  are  needed, 
separation  into  separate  KSs  is  logical. 

The  knowledge  of  the  KSs  is  usually  of  the  following  types 
[Shortliffe,  76;  Davis,  at.al,  77;  Nau,  83]: 

(1)  Methods  for  specifying  cause-effect  relationships, 
imp lications,  or  inferences,  using  production  rules, 
predicate-calculus  expressions,  or  other  logical 
representations,  depending  on  the  richness  of  the 
relationship  to  be  represented. 

(2)  Plans  of  action  for  how  one  would  achieve  an  end 
result  in  the  world  external  to  the  model  that  the 
system  represents.  For  instance,  such  a procedure  may 
describe  how  to  transform  one  chemical  compound  into 
another  for  a chemi  c a 1 - synt he s i s system,  or  how  to 
purify  an  intermediate  compound. 

(3)  Declaratives  that  identify  objects  within  the  modeled 
domain  and  distinguish  them  from  objects  that  are  not 
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within  the  domain.  These  declaratives  may  describe 
properties  of  objects,  relationships  among  objects, 
definitions  of  te  rms  or  constructs,  sch  ema  t a that 
identify  the  legal  relationshlips  or  transfo  rma  t i o n s 
applicable  to  the  domain,  etc. 

(4)  Meta-properties,  which  are  a higher  level  of 

abstraction  about  the  domain  and  the  solution  space 
and  methods.  They  take  the  form  of  meta-rules  - that 
is,  rules  about  using  the  knowledge  in  types  (l),  (2), 

and  (3)  above.  They  provide  a means  for  determining 
and  assuring  the  consistency,  coherency,  and 
reliability  of  intermediate  results  and  steps  as  well 
as  the  final  solution  and  answers.  They  may  also 
restrict  the  solution  space  in  various  ways  (such  as 
pruning  and  ordering  a ’’move’’  tree)  that  markedly 
improves  the  effeciency  of  the  system. 

(5)  Advice  (sometimes  called  heuristics)  that  is  similar 
to  meta-properties  in  intent,  but  that  does  not  carry 
the  same  strength  of  influence.  Advice  may  be  a hint 
to  the  C£  as  to  what  knowledge  is  best  to  use  next  or 
how  to  escape  from  a possible  blind  alley  or  what  is 
the  most  likely  transformation  that  will  yield  a 
useful  result. 
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There  are  a variety  of  techniques  that  have  been  used  to 
represent  KSs  with  these  characteristics  [Fe igenbaum,  81].  They 
will  be  described  in  detail  in  Chapter  3. 

2.4  Cognitive  Engine 

The  Cognitive  Engine  (CE)  combines  and  organizes  the 

contents  of  the  KB  in  inference  or  search  structures  in  order  to 
perform  plausible  or  conmon-s ens e reasoning  about  the  domain  as 
it  applies  to  the  problem  posed  by  the  user.  The  intent  of  the 
CE  is  to  focus  the  effort  as  narrowly  as  possible  on  the  problem 
at  hand. 

The  CE  provides  the  central  control  of  the  KBS.  How  the  CE 
does  this  affects  both  the  power  and  the  performance  of  the 
system,  but  is  not  the  sole  determinant.  A KBS  * s ability  to  solve 
a particular  problem  depends  on: 

( 1 ) How  many  paths  there  are  to  a solution. 

(2)  The  ability  of  the  Cognitive  Engine  to  reduce  the 
number  to  a minimum. 

(3)  The  knowledge  in  the  Knowledge  Base. 

(4)  What  information  is  available  within  the  problem 
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s t a t erne  n t . 

Therefore,  although  the  Cognitive  Engine  is  in  comnand  and  acts 
as  the  driving  element,  the  path  to  a solution,  and  the  criteria 
for  when  to  accept  a solution  or  abort  a particular  path  are 
highly  dependent  on  the  content  of  the  KB  and  the  problem  data. 

To  qualify  as  a KBS,  a system  should  possess  the  potential 
for  explaining  its  actions  and  reasoning  processes  with  respect 
3n  interaction  with  the  user  or  to  a solution  it  produces. 
This  is  another  function  of  the  Cognitive  Engine.  Explanations 
are  given  in  terms  of  the  content  of  the  KB,  the  problem  data  and 
prior  interactions  with  the  user  and  are  related  only  to  past 
activity;  the  system  cannot  explain  how  it  mi  gh t deal  with  a 
hypothetical  case  or  how  it  will  continue  in  solving  a present 
prob 1 em. 

The  CE  must  also  provide  the  mechanisms  that  facilitate  the 

acquisition  of  new  knowledge,  the  modification  of  existing 

knowledge,  and  deleting  erroneous  or  useless  knowledge  - all  of 

which  are  done  in  cooperation  with  an  expert.  A KBS  does  not 

generally  permit  its  users  to  make  permanent  additions  or  changes 
to  the  Knowledge  Base. 

The  knowledge  contained  in  the  CE  may  be  general  or 
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me t a k n ow ledge  about  h ow  to  reason  (infer  or  search.)  as  we  11  as 
domain-specific  problem-solving  knowledge.  The  ultimate  decision 
about  what  kind  and  what  level  of  knowledge  to  incorporate  in  the 
CE  depends  on  the  intent  of  the  system  and  the  complexity  of  the 
domain,  as  well  as  on  considerations  about  performance, 
efficiency,  growth,  and  so  on. 

In  sunmary,  the  CE  is  the  controlling,  active  element  of  the 
KBS  that  directs  the  problem-solving  activities,  explains  the 
system’s  behavior  to  its  users  upon  request,  and  manages  the 
Knowl  edge  Base . 

Some  of  the  techniques  of  CE  are  described  in  Chapter  3. 

2.5  Interface 

The  interface  is  the  comnuni cat i on  port  between  the  system 
and  the  external  world.  As  such,  it  provides  three  functions: 

(1)  Interaction  with  the  user  (i.e.,  accepting  i npu t and 
returning  results,  explanations,  or  other  output  often 
in  English  or  a stylized  natural  language  of  the 
d oma  in). 

(2)  Addition  of  knowledge  to  the  KB  by  a domain  expert. 
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(3)  Acquisition  by  the  KB  of  problem  data. 

These  functions  are  explained  in  more  detail  below: 

(1)  The  User  Interface  should  accomnodate  the  jargon 

specific  to  the  domain  of  the  KBS  and  may  permit  a 
natural  language.  It  provides  the  necessary 

facilities  for  the  user  as  a poser  of  problems  and  a 
consumer  of  results  (answers,  explanations).  It  is 
not  the  port  through  which  expert  knowledge  is  entered 
into  the  system,  nor  is  it  intended  to  support  casual, 
inexpert  users  • 

(2)  The  Knowledge-Acquisition  (Expert)  Interface  is  used 

by  a domain  expert  (who  has  gained  some  feeling  for 
the  system)  as  the  provider  of  knowledge  for  the  KSs. 
Associated  with  the  Knowledge-Acquisition  Interface  is 
some  means  of  verifying  the  incoming  knowledge, 
sometimes  limited  to  syntax  checking,  but  often 

including  tests  for  coherence  and  consistency  with 
prior  knowledge  both  in  the  KSs  and  the  CE 
[Shortliffe,  76].  It  is  possible  that  the  KA 
Interface  and  the  User  interface  use  some  system 
components  in  comnon,  but  they  are  considered 
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logically  separate. 

(3)  The  Data  Interface  is  more  conventional  than  the  other 
two.  It  is  similar  to  that  of  most  other  interactive 


c omp  uter  syst  ems , in  that  it  incorporates: 


(a) 

Facilities  for  user  input 

of  data  and  responses 

to 

the  syst  em*  s queries. 

■ (b) 

The 

me  chan i sm  for  locating 

and  accessing  files 

and 

data  bases. 

Many 

of 

the 

functions  necessary 

to  provide  the  Data 

Interface 

may 

be 

d r awn  directly  fr  om 

the  c ompu t e r - sy s t em 

environment  within  which  the  KBS  functions. 

Separat i on  o f KBS  El ement  s 

The  separation  of  the  elements  of  a KBS  is  a necessary 
condition  for  including  a system  in  that  category,  since  it 
permits  the  changing  of  the  domain  of  application  by  extending, 
expanding,  or  substituting  another  KB  independently  of  the  CE. 
One  example:  EMYCIN  (for  Empty  M5fCIN)  is  the  CE  of  MSfCIN  [Davis, 

et.al,  77]  (also  see  Appendix  A),  to  which  several  different  KBs 
have  been  experimentally  attached  for  solving  different  classes 
of  problems.  Still  there  is  no  general  theory  of  knowledge-based 
systems  complete  enough  to  permit  the  facility  of  substituting  a 
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KB  from  a different  domain  as  a means  of  creating  a new  KBS  for 
that  d oma  i n . 

Even  though  it  was  mentioned  that  a KBS  must  have  a CE  or  a 
KB,  in  most  of  the  systems  they  are  not  so  easily  identifiable. 

2 . 6 Surnna  ry 

In  sunmary,  to  qualify  as  a KBS,  a system  must: 

(1)  Be  externally  invoked  by  an  expert  in  the  domain  of 
app licability. 

(2)  Have  an  identifiable  CE  that  reasons  plausibly  using 

the  KB  and  whose  solution  path  is  controlled  by  the 

content  of  the  KB  and  problem  data. 

(3)  Have  the  potential  for  explaining  its  behavior. 

(4)  Have  an  identifiable  KB  that  contains  expert 

doma i n— s e c i f i c knowledge  (this  is  the  most  critical 
aspect  of  a KBS ) . 

(5)  Be  organized  and  structured  so  that  its  KB  can  be 

expanded  and  extended  and  the  system*s  performance 
improved . 
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3.  TECHNIQUES  USED  TO  CONSTRUCT  KBS 

Artificial  Intelligence  (AI ) techniques  are  widely  used  in 
KBS.  In  addition  to  AI , several  other  computer  science  areas 
have  developed  techniques  that  are  used  in  the  construction  of 
KBS.  A partial  list  of  the  major  contributions  are  sunxnarized  in 
Figure  3-1 . 

The  following  subsections  discuss  KBS  technologies  grouped 
according  to  function.  Section  3.1  describes  the  methods  used  to 
represent  the  knowledge  contained  in  the  Knowledge  Sources  (KS). 
Section  3.2  describes  the  methods  used  to  model  and  represent  the 
work— space  — the  dynamic  state  of  a system  during  its 
problem-solving  activity.  Section  3.3  describes  techniques  that 
are  used  to  construct  the  Cognitive  Engine  (CE).  Section  3.4 
describes  the  techniques  used  to  build  the  interface  between  the 
KBS  and  the  user. 
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Table  3-1  ORIGINS  OF  KBS  TECHNIQUES 
(Based  on  [Hayes-Roth,  83]) 


ARTIFICIAL  INTELLIGENCE  (AI ) 

Hue  r istic  Search 
Inference  and  Deduction 
Pattern  Matching 

Knowledge  Representation  and  Acquisition 
System  Organization 

I^GUAGE  PROCESSING 

Parsing  and  Understanding 
Question  and  Response  Generation 
Knowledge  Representation  and  Acquisition 

THEORY  OF  PROGRANMING  LANGUAGES 

Formal  Theory  of  Computational  Power 
Cont  r o 1 Structures 
Da ta  Structures 
System  Organization 
Pars ing 

NDDELIMj  and  SIMULATION 

Representation  of  Knowledge 
Cont  r o 1 Structures 
Calculation  of  Approximations 

DATA  BASE  MANAGEMENT 

Inf orma t ion  Retri e va I 
Upda  ting 

File  Organization 
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3.1  Knowledge  Representation 

In  contrast  to  conventional  database  systems,  KB  systems 
require  a knowledge  base  with  diverse  kinds  of  knowledge 
knowledge  about  objects,  about  processes,  and  hard-to-repr e s ent 
conxnon  sense  knowledge  about  goals,  motivation,  causality,  time, 
actions,  etc.  Attempts  to  represent  this  breadth  of  knowledge 
raise  many  questions  [McCalla,  et.al,  83]: 

(1)  How  do  we  structure  the  explicit  knowledge  in  a 

knowledge  base? 

(2)  How  do  we  encode  rules  for  manipulating  a knowledge 
base’s  explicit  knowledge  to  infer  knowledge  contained 
implicitly  within  the  knowledge  base? 

(3)  When  do  we  undertake  and  how  do  we  control  such 

inf  erences? 

(4)  How  do  we  formally  specify  the  semantics  of  a 

knowledge  base? 

f 

(5)  How  do  we  deal  with  incomplete  knowledge? 

( 6 ) How  do  we  extract  the  knowledge  of  an  expert  to 
initially  "stock”  the  knowledge  base? 
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(7)  How  do  we  automatically  acquire  new  knowledge  as  time 
goes  on  so  that  the  knowledge  base  can  be  kept 
current? 

In  this  section  we  describe  some  of  the  techniques  used  to 
represent  such  kinds  of  knowledge. 

3.1.1  Knowledge  Representation  Forms  [Feigenbaum,  81] 

A knowledge  source  may  assiune  several  different  forms  of 
representation  through  a KBS.  The  domain  expert  imparts  new 
knowledge  to  the  knowledge  acquisition  mechanism  in  the  external 
form.  The  acquisition  mechanism  transforms  or  compiles  the 
external  representation  into  the  phvs i ca 1 form  and  merges  the  new 
knowledge  into  the  appropriate  KS . The  physical  form  is  a data 
structure  such  as  a matrix,  list,  or  n-tuple,  or  a procedural 
representation,  or  some  combination  of  these  forms.  When  another 
component  of  the  system  (such  as  the  CE)  accesses  the  KS , the 
logical  form  is  used  at  the  interface.  The  logical  form  defines 
the  set  of  questions  that  can  be  answered  inxnediately  by  the  KS . 
Finally,  knowledge  is  transformed  back  into  the  external  form 
when  the  system  provides  explanations  to  the  user.  Figure  3-2 
sunxnarizes  the  transformations  of  knowledge  representations 
throughout  a KBS. 
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There  are  two  important  t eritis/concept  s in  knowledge 
representation  [Feigenbaum,  81]. 

KjidwI  e_dg  e Chunks  . Both  the  external  and  logical  knowledge 
representation  format  are  partially  characterized  by  the  term 
-£-hunk  -S_jlz g « A knowledge  chunk  is  a primitive  unit  in  the 
representation  - that  is,  in  a KS  that  contains  the  definitions 
of  several  interrelated  terms,  the  definition  of  a single  term  is 
a ”chunk**.  The  knowledge  chunk  is  the  unit  by  which  the  expert 
augments  (or  modifies)  the  KS . The  simplest  action  that  can  be 
taken  by  the  CE  is  to  apply  or  use  a single  chunk.  Chunk  size  of 
knowledge  is  an  important  consideration  to  KBS  technology  for 
three  reasons  : 

(1)  It  determines  the  level  at  which  the  expert  can 

instruct  the  system.  If  the  chunk  size  is  either  too 
large  or  too  small,  the  expert  is  forced  into  an 

unnatural  mode  of  expressing  his  knowledge. 

(2)  It  in  part  determines  the  acceptability  of  the 

system’s  explanation  mechanism.  Since  the  knowledge 
chunks  used  to  derive  and  support  the  system’s 

conclusions  form  the  essential  part  of  explanations, 
acceptability  is  enhanced  when  the  chunks  are  the  same 
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size  or  level  of  detail  used  by  one  worker  in  the 
application  field  describing  results  to  another  worker 
in  the  s ame  field, 

(3)  It  determines  the  kinds  and  efficiency  of  reasoning 
techniques  to  be  used  in  the  KBS.  Larger  chunk  sizes 
generally  permit  shorter  lines  of  reasoning.  For  that 
reason,  they  are  more  likely  to  lead  to  a correct 
cone lus ion  wh  en  inexact  but  plausible  inference 
techniques  are  used. 

Credibxl;ity  Factors  [Shortliffe,  76].  All  of  the  knowledge 
in  a KS  need  not  be  true  in  an  axiomatic  sense.  Much  of  the 
content  of  a KS  may  be  **rules  of  thumb”  and  working  hypotheses. 
This  raises  the  issue  of  how  a system  is  to  use  knowledge  of  this 
sort  to  produce  acceptable  results.  In  many  KB  systems,  the 
chunks  in  the  KS  are  rated  as  to  their  credibility  by  the  experts 
who  entered  them  into  the  system.  This  rating  is  then  available 
to  the  CE  as  a guide  in  the  reasoning  process. 

There  are  at  least  four  possible  meanings  or  interpretations 
of  credibility  factors: 

(1)  A probability:  the  fraction  of  the  time  the  chunk  is 
true. 

( 
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(2)  Strength  of  belief:  how  certain  is  the  expert  that  the 
chunk  is  always  true? 

(3)  Acceptability:  is  this  a preferred  method  or  fact  to 

workers  in  the  field? 

(4)  Relevence:  what  is  the  probability  that  use  of  this 
, chunk  will  ultimalely  lead  to  a completed  chain  of 

reasoning  that  solves  the  problem  at  hand? 

It  is  essential  that  the  kind  of  credibility  factor  that  is 
to  be  used  be  stated  and  agreed  upon  by  the  expert  who  instructs 

the  system  and  by  the  programmer  who  builds  the  CE. 

« 

Additional  references  include  the  following:  [Tversky,  72; 

Zadeh  75a;  Zadeh  75b;  Goguen,  68]. 

3.1.2  Methods  of  Representing  KS  [Feigengaum,  81] 

Some  of  the  methods  of  representing  a knowledge  source: 

(l)  Finite-state  machine. 

( 2 ) Programs  . 

(3)  Predicate  calculus. 
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(4)  Production  rules, 

(5)  Semantic  networks, 

( 6 ) F r ame  s , 

(7)  Conditional  probabilities. 


In  this  report  I will  describe  only  production  rules, 
semantic  networks  and  frames.  The  other  methods  will  be 
discussed  in  a subsequent  report, 

3.1.3  Production  Rules  [Feigenbaum,  81] 

Production  rules  have  been  used  as  the  principal  method  of 
representing  knowledge  in  many  (if  not  most)  of  the  highly 
successful  KB  systems  - for  example,  MYCIN  and  DENDRAL. 

A produc  X \ on  Jfu  1 ^ is  a specification  of  a conditional 
action.  It  consists  of  a left  hand  side  (LHS),  also  called  the 
condition  or  the  antecedent,  which  describes  a situation,  and  a 
J 1 g h t,  -hand  side  (RHS),  also  called  the  action  or  consequence, 
which  describes  something  that  may  legally  be  done  in  a situation 
described  by  the  LHS. 

For  example,  in  ”If  you  are  outdoors  and  it  is  raining,  then 
open  an  umbrella”.  The  conditions  are  ’being  outdoors*  and 
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’rain*.  The  action  is  to  open  an  umbrella. 

Production  is  a three-component  entity: 

(l)  A collection  of  production  rules. 

( 2 ) A wo  r k s p a c e . 

(3)  A control  mechanism. 

The  production  rules  are  represented  by  some  agreed-upon 
syntax,  by  means  of  which  the  LHS  and  RHS  are  built  up  from  a set 
of  primitives  and  symbols  that  correspond  to  objects,  functions, 
and  predicates  in  a domain.  The  workspace  contains  the  total 
description  of  the  system's  current  state  or  situation.  The  LHS 
of  a rule  describes,  or  is  matched  against,  the  contents  of  the 
workspace.  If  a production  is  applied,  i.e.,  its  LHS  matches  and 
its  RHS  is  executed,  then  the  RHS  actions  modify  the  workspace. 

The  control  mechanism  has  two  parts.  The  first  part  builds 
the  1 i c t t - the  set  of  all  production  rules  whose  LHSs  are 

satisfied.  If  the  conflict  set  is  empty,  then  processing  is 
terminated,  and  the  result  is  the  contents  of  the  workspace. 
However,  if  the  conflict  set  is  not  empty,  then  the 
-CQJif  1 1 c t-resolut  ion  strategy  selects  one  member  of  the  conflict 
set  and  the  RHS  of  the  selected  production  rule  is  executed. 
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Several  conflict-resolution  strategies  have  been  used  or 
proposed. 

Bd  1 ff  order  — There  is  a complete  ordering  of  all  production 
rules.  The  rule  in  the  conflict  set  that  is  highest  in  the 
ordering  is  chosen. 

■Ru  1 ^ precedence  — A precedence  network  determines  an 
o r de  r i ng  . 

Generality  order  — The  most  specific  rule  is  chosen. 

D.a t a order  - Elements  of  the  workspace  are  ordered.  The 
rule  chosen  is  the  one  whose  LHS  references  the  h i ghe s t — r ank i ng 
workspace  element(s). 

Regency  iirde r - Execute  the  rule  in  the  conflict  set  that 
was  most  (least)  recently  executed,  or  the  rule  in  the  conflict 
set  wh o s e LHS  references  the  mo st  (least)  recently  referenced 
e 1 erne  n t ( s ) . 

Non-de termini s t i c - Execute  every  rule  in  the  conflict  set 
as  if  it  were  the  only  member.  Computation  stops  when  any  path 
terminates . 


I DBMS. NASA/ RECON- 5 I 


39 


I KNCWLEDGE-BASED  I 


I N A S A I 


1 N A S A 1 


3 •1.4  An  Example 

The  example  is  a production  system  that  assists  the  service 
manager  and  mechanics  in  an  automobile  repair  agency  (refer  back 
to  Section  2.1).  The  scenario  for  using  this  system  is  the 
arrival  of  a customer  at  the  agency.  He  reports  the  symptoms  and 
problems  to  the  service  representative,  who  then  enters  this 
information  into  the  system.  The  system  has  at  its  disposal  a 
data  base  of  past  problems,  repairs  and  services  performed  on  the 
vehicle,  and  a KS  of  production  rules  that  describe 
caus e-and-e f f e c t relationships  among  the  performance 
characteristics  and  me  asurable  attributes  of  an  aut  omo  bile. 
Using  the  reported  information,  the  past-history  data  base,  and 
the  KS , a diagnostic  and  repair  plan  is  formulated  and 
imp  1 ement  ed  , 

Figure  3-3  gives  a few  of  the  production  rules  that  might 
be  present  in  such  a system.  Each  rule  is  named;  however,  the 
rule  names  are  used  only  for  convenience.  The  format  of  the  rule 
i s : 


IF  Ihsl  Cl  lhs2  ....  Cn— 1 Ihsn 

THEN  rhsl[pl]  K1  rhs2[p2]  ....  Km-1  rhsm[pm] 
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R1  IF  fan  belt  tension  is  low 

THEN  alternator  output  will  be  low  [.5]  and  engine  will 
overheat  [ . 2] 

R2  IF  alternator  output  is  low 

THEN  battery  charge  will  be  low  [.7] 

R3  IF  battery  is  low 

THEN  car  will  be  difficult  to  start  [.5] 

R4  IF  automatic  choke  malfunctions  OR  automatic  choke 
needs  adjus  tme  n t 

THEN  car  will  be  difficult  to  start  [.8] 

R5  IF  battery  is  out  of  warranty 

THEN  battery  charge  may  be  low  [.9] 

R6  IF  coolant  is  lost  OR  coolant  system  pressure^  cannot  be 
ma  intained 

THEN  engine  will  overheat  [.7] 

R7  IF  there  is  a high  resistance  short  AND  fuse  is  not 
b 1 own 

THEN  battery  charge  will  be  low  [.8] 

R8  IF  battery  fluid  is  low 

THEN  battery  will  boil  off  fluid  [.3] 

R9  IF  battery  fluid  is  low 

THEN  battery  charge  will  be  low  [.4] 


Figure  3-3  PRODUCTTION  RULES  FOR  AUTCM)TIVE  SYSTEM  KS 
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where  the  Cl  and  K1  are  the  connectives  AND  or  OR.  The  LHS  is 
evertything  between  the  keyworkds  IF  and  THEN,  and  the  RHS  is 
everything  following  the  THEN.  Each  Ihs(i)  is  an  observable  or 
measurable  condition  predicate,  e.g.,  that  the  tension  of  the  fan 
belt  is  low  or  the  engine  is  overheating.  Each  rhs(i)[p(i)]  is  a 
condition,  rhs(i),  that  will  follow  with  certainty  or 
probability,  p(i).  Thus  rule  R1  says  that,  if  the  tension  of  the 
fan  belt  is  low,  then  there  are  two  possible  consequences: 

(1)  That  about  one— half  of  the  time  the  output  of  the 
alternator  will  be  1 o w . 

(2)  About  one— fifth  of  the  time  the  engine  will  overheat. 

The  other  production  rules,  R2-R9 , are  interpreted  in  a 
similar  manner. 

A fact  file  in  the  system  is  shown  in  Figure  3—4.  The 
information  included  for  each  observation  or  measure  is  the  agent 
from  whom  to  gather  data  and  the  relative  difficulty  (or  cost)  of 
gathering  the  data. 
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OBSERVATIONS 

AGENT 

DIFFICULTY 

Alternate  Output  Level 

Me  ch 

4 

Battery  Charge  Level 

Mech 

3 

Battery  Fluid  Level 

SrvR 

2 

Choke  Adjustment 

Mech 

5 

Choke  Func  t i on 

Mech 

5 

Coolant  Level 

SrvR 

2 

Coolant  System  Pressure 

Mech 

5 

Difficulty  to  Start 

Cu  s t 

1 

Eng i ne  Tempe  ra  t ur e 

Cu  s t 

1 

Fan  Belt  Tension 

Mech 

3 

Fuse  Cond i t i on 

SrvR 

2 

Short  in  Electric  System 

Mech 

8 

Voltage  Regulator  Level 

Mech 

4 

Warrant i es 

Data  Base 

0 

Figure  3-4  DATA  GATHERING  PROCEDURE  FACT  FILE 
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The  r e 

are  four  possible  agents 

for  data 

gathering : 

(1) 

The  customer  (Gust). 

(2) 

The  historical  data  base 

(3) 

Inspection  by  the  service 

manage  r 

( Sr vR)  . 

(4) 

Measurement  by  the  mechanic  (Mech) 

• 

The 

difficulty  info  rma  t i on 

will  be 

c omb  i n e d 

confidence  factors  in  the  production  rules  to  fo  rmu  late  the  mo  s t 
cost-effective  and  timely  plan  for  the  needed  diagnostics  and 
repairs . 


Assume  that  a customer  arrives  at  the  agency  with  the  vague 
complaint  that  his  car  is  hard  to  start.  The  service  manager 
enters  this  information,  including  appropriate  customer  and 
vehicle  identification.  The  system  then  grows  a structure 
similar  to  that  shown  in  Figure  3-5.  The  boxes  are  labeled  with 
observable  or  measurable  symptoms  and  are  connected  by  arrows 
labeled  with  the  names  of  the  production  rule  they  represent.  To 
the  far  right  of  each  of  the  unknown  values  (e.g.,  the  box 
labels,  such  as  battery-fluid  level),  the  associated  agent  and 
relative  difficulty  are  listed.  At  this  point,  the  system  would 
check  the  data  base  for  information  about  the  battery’s  warranty. 
If  nothing  decisive  was  found,  then  the  customer  would  be  asked 
whether  the  car  was  running  hot,  and  the  service  manager  would 


I DHS1S.NASA/RECX)N-5  I 


44 


I KNOWLEDGE- BASED  I 


I N A S A 1 


I N A S A 1 


continue  to  ma ke  on-the-spot  observations.  Diagnostic  procedures 
for  causes  not  ruled  out  by  the  procedure  to  date  would  then  be 
placed  on  an  ordered  schedule  for  a me c h a n i c • 

The  ordering  wou Id  be  based  upon: 

(1)  Cost  effectiveness  - a function  of  test  difficulty, 
estimated  probability  of  being  necessary,  and  ability 
to  eliminate  other  tests. 

(2)  Availability  of  resources  - speciality  mechanism  and 
test  equi pme  n t . 
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AGENTS 


mech(5) 

mech(5) 

srvr(2) 

mech(8) 

mech(3) 

db(0) 

srvr(2) 

MECH(^i) 

MECH(i|) 

mech(3) 

cust(I) 


FIGURE  3.5  B^PLE  FLOW  IN  AUTO  DIAGNOSTIC  SYSTEM 
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The  structure  shown  in  Figure  3-5  was  grown  by  an  algorithm 
called  back  chaining.  A condition  - in  this  case,  "difficult  to 
~ is  taken  as  a given,  and  the  goal  of  the  syst em  is  to 
find  the  cause(s).  Note  that  the  production  rules  state  causes, 
then  effects.  Thus,  the  rules  are  used  as  if  the  knowledge 
possessed  a kind  of  s yimie  try.  The  back— chaining  algorithm  is: 

(1)  Find  all  rules  that  have  the  initial  or  derived 
condition  as  their  consequence  (in  this  case  R3  and 
R4)  . 

(2)  Call  the  antecedents  (LHSs)  of  these  rules’  derived 
cond i t i ons . 

(3)  Repeat  steps  (l)  and  (2),  and  terminate  when  no  more 
can  be  done . 

Figure  3—6  graphically  shows  the  kind  of  structure  grown 
for  each  kind  of  rule  format.  In  each  example  in  the  figure,  cl 
is  the  initial  or  a derived  condition. 

Rule  El  is  the  simplest;  al  is  added  to  the  set  of  derived 
conditions.  Rule  E2  states  that  if  al  is  the  case,  then  both  cl 
and  c2  ought  to  follow.  Thus,  al  is  a derived  condition,  and  c2 
may  or  may  not  be  considered  a derived  condition,  depending  upon 
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the  particular 

Strategy  used 

by  the 

sy  s t em. 

Rule 

E3 

i s 

equivalent  to  two 

independent  rules  ’’IF 

a 1 

THEN  Cl” 

j 

and 

"IF 

a 1 

THEN  c2”.  Therefore,  al  is 

added 

to 

the  set 

of 

de  r i ved 

conditions,  and  c2  part  is  ignored. 

The  example  and  discussion  is  some  what  simplistic,  because 
there  might  be  some  problems  which  we  did  not  consider.  For 
example,  suppose  that  rule  R8  (in  Figure  3-3)  had  been  written 
more  accurately  as  the  two  rules: 

R8 ( 1 ) IF  voltage  regulator  output  is  high 
, THEN  the  battery  will  overcharge. 

R8(2)  IF  battery  is  overcharged 

THEN  battery  will  boil  off  fluid. 
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El  If  A1  THEN  Cl 


E4  IF  A1  AND  A2  THEN  Cl 
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With  these  new  rules,  a fragment  of  the  structure  shown  in 
Figure  3-5  would  be  replaced  by  that  shown  in  Figure  3-7,  Now, 
the  interesting  conclusion  is  that  a high  battery  charge  implies 
a low  battery  charge.  This  is  an  apparent  contradiction,  since 
both  conditions  cannot  hold  at  the  same  time.  This  kind  of 
situation  can  often  arise  in  unpredicted  ways  if  the  system 
contains  many  rules  - more  than  a few  dozen.  The  charge  of  the 
battery  will  oscillate  between  high  and  low  as  the  battery  fluid 
is  replaced  and  boils  off,  respectively.  So,  in  a sense,  there 
is  a missing  rule  of  the  form  that  adding  fluid  to  a battery 
whose  charge  and  fluid  levels  are  low  will  probably  allow  the 
battery  to  return  to  normal  conditions.  However,  to  handle  this 
kind  of  situation  in  general,  it  is  necessary  that  the  control 
mechanism  or  CE  have  some  knowledge  about  how  to  proceed  when 
faced  with  apparent  conflicts  and  contradictions.  One  virtue  of 
production  systems  is  that  ad  hoc  knowledge  may  be  relatively 
easily  incorporated  in  the  system  to  handle  this. 

Additional  relevant  references  include  the  following: 
[Davis,  et.al,  77;  Shortliffe,  76;  Shortliffe  75;  Buchanan,  76; 
Feigenbaum,  71;  Barnett,  75;  Collins,  76;  Forgy,  76]. 
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FIGURE  3.7  ERAGMENT  OF  GRAPH  RTRiimiPF 
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3.1.5  Semantic  Networks  [Nau,  83;  Feigenbaum,  81] 

A semantic  network  is  a method  of  representing  declarative 
knowledge  about  the  relations  among  entities.  The  major 
application  has  been  to  include  non-syntactic  knowledge  (e.g., 
semantics)  in  natural-language  understanding  systems.  Because  of 
their  i nhe r en t ' g e ne r a 1 i ty  and  naturalness,  semantic  network  have 
been  used  to  represent  highly  interrelated  information  that 
cannot  be  properly  processed  by  standard  data  base  management 
t e chn i que  s . 

A semantic  network  is  a KS . It  is  built  up  from  knowledge 
chunks  that  are  instances  of  a relation.  The  format  of  a chunk 
is:  rel  (al  ...  an),  where  rel  is  a relation  name  and  the  ordered 

tuple,  (al  ...  an),  is  in  the  relation  rel.  For  ex  amp  1 e , I S A 
» M2inina  1 ) means  (Dog,  Mamnal)  is  a member  of  the  relation 
ISA.  ISA  is  conventionally  taken  to  be  the  relation, 
mo r e- s pe c i f i c-exmap 1 e-of . Thus,  the  above  is  the  representation 
of  the  fact  that  a Dog  is  a specific  kind  of  Mamnal. 
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RELATION? 

TEMP (warm-blooded  MAMMAL) 

ISA (dog ^mammal)  isa(cat> mammal) 
isa(fido^dog)  ISA (bowser > dog)  isa(puff^cat) 
loc(mary's^fido)  loc(firehouse^bowser)  log (bob 's> puff) 

COLOR (TAN^ FIDO)  COLOR (TAN^ BOWSER)  COLOR(bLACK, PUFF) 

size(40lb^fido)  s I ZEd^LB^ bowser)  size(4lb,puff) 

BETWEEN (MARY ' S^  F I REHOUSE^  BOB ' S ) 


SEMANTIC  NETWORK 

MAMMAL 


RULES  OF  INFERFNCF 

isa(x^y)  a isa(y^z)  =>  isa(x.z) 
size(x^y)  a sizE(UyV)  A x<u  =>  smaller(y^v) 
isa(x^y)  ^ r(u>y)  =>  r(u^x) 

FIGURE  3,8  EXAMPLE  SEMANTIC  NETWORK 
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Figure  3-8  shows  a semantic  network  (or  net).  The  top  of 
the  figure  lists  the  instances  of  relations  using  the  relation 
names  TE^^P , LOC.  COLOR,  SIZE.  ISA,  and  BETWEEN.  TEMP(a.b)  means 
a is  the  temperature  of  b;  LOC(a.b)  means  a is  located  at  b; 
COLOR ( a , b ) me  ans  that  a is  the  color  of  b;  and  SI ZE ( a , b ) me  a n s a 
is  the  size  of  b.  The  knowledge  in  a semantic  net  is  given 
meaning  by  defining  the  relation  names  and  other  symbols  used  in 
the  instances  of  relations,  in  terms  of  external  entities. 

The  graph  in  the  middle  of  Figure  3—8  shows  exactly  the 
same  knowledge  that  is  in  the  set  of  instances  at  the  top  of  the 
figure.  The  entity  names  are  connected  by  arrows  labeled  with 
appropriate  relation  names. 

The  external  format  of  knowledge  in  a semantic  network  is 
usually  very  similar  to  the  one  used  here.  However,  the  internal 
storage  of  the  semantic  network  closely  corresponds  to  the 
graphical  presentation  — that  is,  a network  structure  built  using 
pointers  and  list  structures.  The  explicit  connections  among  the 
entities  enhances  efficiency  of  programs  that  search  through  the 
semantic  network. 

Th  e b o 1 1 om  of  Figure  3-8  gives  s ome  e x amp  1 e s of  i nf  e r enc  e 
J H 1 ^ S for  the  semantic  network.  It  is  possible  to  represent  the 
inference  rules  as  a production  system.  This  has  the  advantage 
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of  allowing  procedural  knowledge  to  be  used  to  test  for  complex 
c ond i t i on  s . 

The  first  rule  says  that  (for  all  x,  y,  and  z)  if  x is  a y 
and  y is  a z,  then  x is  also  a z.  An  example  of  this  is:  Fido  is 
a Dog  and  a Dog  is  a Manma  1 ; therefore,  Fido  is  a Manma  1 . The 
second  rule  says  that  if  y and  v are  two  entities  that  have  SIZE, 
and  the  size  of  y is  less  than  the  size  of  v,  then  y is  SMALLER 
than  V.  Thus  the  instance  of  the  relation,  SMALLER(Puf f , 
Bows  e r ) . 

This  inference  rule  defines  instances  of  relations  whose 
names  do  not  appear  explicitly  in  the  semantic  network.  The  last 
example  inference  rule  says  that,  if  x is  a y,  and  y has'  a 
property  conferred  by  the  binary  relation,  r,  then  x has  the  same 
property  conferred  by  r,  i.e.,  properties  are  inherited.  Thus, 
Fido  is  a Manmal  (by  the  transitivity  of  ISA  - first  rule),  and  a 
Mamna  1 has  the  property,  WARM-BLOODED  (conferred  by  the  relation 
TPMP),  therefore,  Fido  i s WARM-BLOODED. 

However,  the  indiscriminate  use  of  the  third  rule  can  cause 
derivation  of  incorrect  results.  For  ex  amp  1 e , 

ISA(Dog,  Manmal)  AND  ISA(Cat,  Manmal)  ==>  ISA(Dog,  Cat) 


I DB4S  .NASA/ RECON- 5 I 


55 


I KNCWLEDGE-BASED  I 


! N A S A I 


I N A S A I 


In  order  to  avoid  this  kind  of  problem,  it  is  necessary  to 
have  s ome  k n o w ledge  (non-syntactic)  about  the  relations  to  wh i c h 
inference  rules  are  applied.  One  possible  solution  is  to  have  a 
rule,  such  as  the  third  example  rule,  for  each  relation  that  is 
i nhe  r i t a b 1 e . Ano  t he  r solution  is  to  embed  the  inference  rules  in 
the  CE  along  wi  th  the  necessary  ad  hoc  knowl  edge  to  avoid  the 
problems.  If  the  number  of  relations  occurring  in  the  semantic 
network  is  large  or  if  the  relation  set  can  be  modified  or 
expanded  — then  both  these  approaches  cause  probl  ems . 

A more  general  approach  to  the  problem  treats  relation  names 
and  entity  names  more  uniformly.  For  example,  temperature  is 
defined  as  an  inheritable  property  by  an  instance  like 
I NHER I TABLE  ( TEMP  ) . 

The  third  inference  rule  is  then  rewritten  as: 

ISA(x,y)  AND  r(u,y)  AND  INHERITABLE( r ) ==>  r(u,x) 

With  this  approach,  relations  can  be  arguments  to  relations, 
and  hence  have  the  same  properties  as  other  entities. 

Another  choice  and  tradeoff  about  a semantic  network  is  the 
decision  about  which  relations  and  which  instances  in  the 
relations  ought  to  be  stored  explicitly  and  which  should  be 
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computed  via  the  inference  rules.  Explicit  storage  costs  space» 
and  inference  rules  cost  computation  time. 

A technique  often  used  with  semantic  networks  is  to  make  a 
distinction  between  general  knowledge  and  specific  knowledge  and 
to  store  the  two  in  a different  manner.  Specific  knowledge  has 
the  general  characteristic  of  being  "*low'*  in  the  tree  - as  shown 
in  the  middle  of  the  figure.  This  means: 

/ 

(1)  There  are  few  if  any  chains  below  it. 

(2)  Therefore,  properties  have  simple  values. 

( 3 ) Mo  st  entities^  in  the  s ame  general  classification  have 
all  and  only  a known  set  of  properties. 

(4)  There  are  a large  number  of  entites  in  a general 
class.  For  our  example,  the  specific  knowledge  can  be 
displayed  tabularly  as: 


ENTITY 

ISA 

SIZE 

COLOR 

LOC 

Fido 

Dog 

4011b 

Tan 

Mary ’ s 

Bowser 

Dog 

1411b 

Tan 

F i rehous  e 

Puff 

Cat 

411b 

Black 

Bob  * s 

The 

above  conditions 

make  i t 

likely 

that 

the 

specific 

knowledge 

can  be  gathered 

into  a 

tabular 

f orm 

by 

s imp  1 e 
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mechanical  means,  and  that  the  specific  knowledge  (which  is 
usually  most  of  the  semantic  net)  can  be  kept  in  relatively 
inexpensive  secondary  storage  and  even  accessed  through  an 
efficient,  existing  data  management  system.  The  general 
knowledge  is  kept  in  primary  memory.  Fortunately,  most 
processing  by  the  inference  rules  occurs  on  other  than  the 
"bottom”  of  the  network,  so  that  efficiency  is  maintained. 

Semantic  networks  are  by  far  the  best  available  technology 
for  representing  definitional  and  relational  knowledge  that  is 
too  complex  for  ordinary  data  management  techniques.  This  is  the 
case  because  the  structure  allows  for  the  inclusion  of  ad  hoc 
info  r ma  tion,  and  the  utilization  of  inference  rules  pe  rm  its 
straightforward  enhancement  of  the  inherent  representational 
power  and  completeness. 

On  the  other  hand,  there  are  some  disadvantages  to  the  use 
of  semantic  networks  to  represent  knowledge  in  a KBS.  The 
principal  one  is  that  the  chunk  size  is  fairly  small.  The  result 
of  this  is  that  reasoning  chains  can  be  quite  lengthy  and 
tedious.  Another  result  is  that  processing  a semantic  net  can 
constune  large  amount  of  computer  time. 

Additional  references  include  the  following:  [Duda,  et.al, 
77;  Grignetti,  75;  Nfylopaulos,  et.al,  75;  Norman,  75;  Woods,  75; 
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Schube  r t , 76  ] . 

3.1.6  F r ame  s 

A research  topic  of  great  current  interest  in  c omp u t e r 
representation  of  knowledge  is  frame  theory.  No  one  has  succeded 
in  defining  frames  to  all  researchers*  satisfaction.  Some  of  the 
c omno  n features  in  proposals  about  fr  ame  s are: 

(1)  A frame  is  a knowledge  chunk. 

(2)  A frame  has  a collection  of  definitional  and  procedural 

knowledge  about  an  object,  action,  or  concept. 

(3)  A frame  is  a complex  data  structure  that  has  named  slots 

corresponding  to  definitional  characteristics. 

(4)  A frame  has  the  ability  to  attach  procedural  knowledge 

to  the  slots  and/or  to  the  frame  itself. 

An  e X amp le  (Figure  3 — 9)  to  illustrate  s ome  of  the  above  features 
is  discussed  bel  ow . 

Th e top  of  the  figure  presents  definitional  info rma t i 0 n 
about  a dog.  The  first  line  states  that  a dog  is  a **niaiiina  1 ** . 

The  next  line  means  that  there  is  a slot,  named  "kind”  (of  dog), 
that  may  be  filled  with  a value  of  (type)  "breed".  ("Breed”  in 
this  example  is  itself  a frame).  The  color  of  a dog  is  limited 
to  one  or  a mixture  of  the  stated  colors  by  the  SUBSET. OF 
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operator.  Default  values  are  indicated  by  underlining,  and  the 
FRCM  operator  is  used  to  pick  out  values  from  other  frames. 
Thus,  the  combined  effect  of  the  phrase  FRCM  color  OF  kind  is 
t o ma ke  the  default  value  for  the  color  of  a dog  the  default  for 
his  breed.  The  state  of  a dog  is  either  "adult”,  the  default,  or 
"puppy”  if  the  age  is  known  to  be  less  than  one  year. 

The  bottom  of  the  figure  shows  a frame  for  "boxer”  and 
declares  that  boxer  is  a breed  - but  only  a breed  of  dog.  The 
color  of  a boxer  is  restricted  to  one  of  the  colors  "tan”, 
"brown”,  and  "brindle”,  with  a default  of  "tan”.  If  this  breed 
did  not  have  a characteristic  color  restriction,  then  this  slot 
would  be  omitted.  The  next  slot  says  that  the  siz^  of  a boxer  is 
between  40  and  60  pounds.  No  default  is  specified.  The  tail  and 
ears  slots  are  defined  with  default  value  "bobbed”  and  the 
respective  alternatives  of  "long”  and  "floppy”. 
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FRAME  ISA 

manma  1 

kind  breed 

color  SUBSET, 

. OF  {tan  b r own  black  wh ite  rust) 

£RCM  ci5lor  OF 

kind 

1 eggedne  s s 

0,  . .A 

we  i gh t 

>0.  FRCM  size  D£  kind 

state 

adult  OR  puppy  if  age  < 1 

age 

> 0 , now  birthday 

bi r thday 

date 

name 

s tr ing 

END 

dog 

boxer 


FRAME  ISA 

color 

size 

tail 

ears 

t emp  e rme  n t 
(XMPLAINTS 

END 


breed  OF  dog 

ONE.  OF  { t an  brown  br  indie} 

40. ..60 

bobbed  OR  long 
bobbed  OR  floppy 
p 1 ayf  u 1 

IF  weight  > 100  THEN  ASSUME 

(great  dane) 

boxer 


Figure  3-9  EXAMPLE  FRAME  DEFINITIONS 
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Temperment  is  shown  to  always  be  playful.  The  last 
line  shows  an  example  of  a complaint  and  ad  hoc  knowledge 
used  to  make  a recomnenda t i on , namely,  if  you  see  a giant 
boxer,  then  assume  that  it  might  be  a Great  Dane  instead. 

Figure  3 — 10  shows  an  example  use  of  frames  in  a 
recognition  task.  The  top  of  the  figure  shows  some  feature 
values  (c.g.,  color  is  tan,  ears  are  bobbed)  that  have  been 
detected  for  an  object,  here  identified  as  number  456.  The 
CE  has  matched  the  known  feature  values  with  the  available 
frames  and  has  manufactured  the  working  hypothesis  shown  at 
the  bottom  of  the  figure  - namely,  a boxer  dog  that  is 
assumed  to  have  bobbed  tail  and  to  be  an  adult.  It  is  noted 
that  this  particular  boxer  (object  number  456)  is  mean  and 
that  this  is  exceptional.  Also,  the  size  of  the  boxer  was 
only  approximately  known,  but  the  approximation  has  been 
used  in  lieu  of  a more  accurate  value. 
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LCW- LEVEL 
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A possible  scenario  for  the  recognition  task:  A 
general  matching  procedure  would  attempt  to  instantiate  all 
frames  in  the  system  until  a reasonable  fit  was  found;  in 
the  example,  ”boxer”  is  a reasonable  match.  Slots  that  are 
yet  unfilled  would  be  used  to  hypothesize  other  values  not 
yet  detected.  For  the  boxer  fr ame  , a bobbed  tail  wo u 1 d be 
predicted  and  put  on  an  agenda  of  things  to  look  for. 
Assuming  there  was  a frame  for  tails,  it  might  possibly 
contain  heuristic  knowledge  about  how  to  more  carefully  scan 
the  raw  data  to  confirm  or  deny  the  existence  of  a 
particular  kind  of  tail.  Other  activity  that  could  emanate 
from  the  boxer  frame  is  the  activation  of  a complaint. 
Thus,  if  the  weight  of  the  boxer  was  too  large,  the 
complaint  mechanism  could  change  the  identification  of  the 
instantiation  of  the  boxer  frame  into  one  for  a Great  Dane. 

Besides  the  prediction  and  correction  activity 
resulting  from  the  partial  match  to  a frame,  a third  process 
can  be  tried.  Namely  if  the  match  is  good  enough,  then  the 
frame  can  become  more  informative.  For  our  example,  the 
t rans  f ormaton  is  from  a boxer  to  a boxer  dog  where  more 
information  is  absorbed,  e.g.,  leggedness. 

The  belief  is  that  this  style  of  recognition  will  be 
more  goal  directed  - and  hence  more  accurate  and  efficient  - 
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than  general  techniques  that  depend  upon  regularity  and 
uniformity  of  structure. 

Additional  relevant  references  include  the  following: 
[Nilsson,  80;  Winston,  77;  Bobrow,  77;  Winograd,  75; 

Malhotra,  75;  Davis,  76]. 

3 . 2 Wo rkspace  Representation 

The  workspace  is  the  encapsulation  of  the  system’s 
current  state  in  a problem  solving  activity.  It  includes: 

(1)  Global  variables  - computed  values,  goals,  and  input 
problem  parameters. 

(2)  An  agenda  - a list  of  activities  that  can  be  done 
nex t . 

(3)  A history  - what  has  been  done  (and  why)  to  bring  the 
system  to  its  current  state. 

The  simplest  example  of  a workspace  representation  is  the 
push-down  stack  in  a LISP-like  system.  The  stack  contains  the 
bindings  of  global  variables,  return  address  (a  history 
snapshot),  and  the  values  of  temporaries.  There  is  no  agenda  in 
a simple  system  other  than  the  program  counter.  A more 
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complicated  example  is  the  data  base  in  a production  system.  It 
contains  the  entire  state  of  the  system,  including  an  implicit 
agenda  (the  conflict  set  of  rules  that  can  apply). 

In  most  computer  programs,  the  workspace  can  be  represented 
in  an  ad  hoc  way  using  whatever  techniques  are  provided  by  the 
containing  proram-language  system.  However,  this  is  not  always 
in  KB  system  because: 

The  capability  to  provide  explanations  is  based  in 
part  on  an  ability  to  find  the  trace  of  events 
(history)  that  produced  the  solution. 

Efficient  reasoning  behavior  depends  on  the  selection 
of  the  next  thing  to  be  done  - hence,  the  necessity 
for  an  explicit  agenda  and  visibility  of  enough  state 
(global  variables)  to  ma  k e info  rme  d decisions. 

Further,  if  a KBS  has  many  knowledge  sources,  the 
workspace  representation  may  be  used  to  provide  a 
conxnun  i ca  t i on  channel  among  them. 

3.3  Cognitive  Engine 

In  a KBS,  the  primary  function  of  the  cognitive  engine  (CE) 
is  to  perform  the  task  of  problem  solving.  A secondary  function 


adequate 

(1) 

(2) 
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of  the  CE  is  to  explain  the  behavior  of  the  system  and  support 
its  derived  solutions.  To  acc omp lish  these  functions,  the  CE 
mus  t : 

(1)  Control  and  coordinate  system  activities  and 

resource  s . 

(2)  Plausibly  reason  about  doma  in-spec i f i c problems  by 

having  access  to  and  using  the  contents  of  the  KB,  the 
contents  of  the  workspace,  and  knowledge  and 

procedures  embedded  in  the  CE. 

(3)  Link  the  KB  with  the  interface  module(s). 

The  CE  is  the  most  active  component  of  a KBS.  That  is,  it 
is  always  instantiated,  and  it  controls  the  activation  and 
utilization  of  other  system  modules.  Another  characterization  of 
a CE  is  that  it  is  the  intelligence  or  understanding  component  of 
a KBS  (even  though  its  activity  may,  to  a degree,  be  guided  by 
higher-level  (control  and/or  meta)  knowledge  in  a KS) . 

The  following  three  definitions  are  from  [Feigenbaum,  81]. 

A CE  is  sound  if  it  produces  only  correct  or  don't  know” 
solutions,  i.e.,  it  does  not  produce  incorrect  solutions. 
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A CE  is  c Qmp  if  it  can  always  produce  a solution  to  a 

posed  problem  when  a solution  exists. 

A CE  is  admi  s s i b 1 e if  it  always  finds  a minimal-cost 
solution  when  a solution  exists.  The  cost  is  taken  to  mean  the 
cost  of  using  the  solution,  not  necessarily  the  cost  of  finding 
i t . 

3.3.1  CE  Strategies 

The  input  to  a CE  is  usually  a set  of  initial  conditions  and 
a goal.  The  KB  is  used  in  some  manner  to  find  a method  of 
obtaining  the  goal  given  the  constraints  imposed  by  the  initial 
conditions.  There  are  four  ways  of  doing  this: 

( rd  cha  ini  ng  - ^Pply  the  KB  to  the  givens  to  infer 
new  conditions;  continue  in  this  manner  until  the  goal 
is  satisfied. 

(2)  .fcJxAining  - apply  the  KB  to  the  goal  to  produce 
itew  subgoa  1 s r continue  in  this  manner  until  the 
initial  constraints  or  primitive  conditions  (known  to 
be  solvable)  are  reached. 

(3)  Chain  both  ways  - forward  chain  from  the  initial 
conditions  and  backward  chain  from  the  goal  until  a 
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conrnon  middle  term  is  produced. 

(4)  Middle  term  chaining  - using  the  KB,  guess  a middle 
term  and  solve  separately  the  problem  of  getting  from 
the  initial  conditions  to  the  middle  term  and  from  the 
middle  term  to  the  original  goal;  continue  in  this 
manner  until  a solution  in  terms  of  primitives  is 
generated.  ( Th i s me  thod  is  also  called  p r o b 1 em 
reduct  ion. ) 

Figure  3-11  shows  an  example  of  the  first  three  of  these 
techniques.  The  KB  contains  three  rules: 

(1)  Any  integer,  x,  can  be  replaced  by  2x  (x  — > 2x). 

(2)  Any  even  integer,  2x,  can  be  replaced  by  x (2x  — > x). 

(3)  Any  integer,  x can  be  replaced  by  3x+l  (x  — > 3x  + 1). 

The  problem  is  to  transfer  4 into  20  using  the  permitted 
operations.  The  top  figure  shows  forward  chainging  - i.e.,  start 
with  4 and  apply  the  operations  until  20  is  produced.  The  middle 
figure  shows  back  chaining  - i.e.,  start  with  the  goal,  20,  and 
use  the  inverse  of  the  above  rules  and  continue  until  4 is 
produced.  The  bottom  figure  shows  the  chain— both— ways  technique. 
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First,  one  step  of  back  chaining  produces  the  nodes  labeled  10 
and  40.  Then  one  step  of  forward  chaining  produces  the  nodes 
labeled  8,2,  and  13.  Finally,  one  more  step  of  back  chaining  is 
done  to  produce  the  nodes  labeled  5,3,13,  and  80.  Since  13  is  on 
both  the  forward  and  backward  grown  "wave  fronts”,  the  process 
can  terminate;  otherwise,  the  steps  of  forward  and  backward 
chaining  would  continue  to  alternate  until  either  a solution  was 
found  or  the  system  gave  up. 
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Another  way  of  differentiating  CE  strategies  is  via 
^.rgadth-jf  irst  vs  , depth-first  . in  a breadth-first  system,  all 
possible  methods  of  continuing  are  attempted  in  parallel.  This 
is  showed  in  Figure  3-11,  where  each  (horizontal)  level  of  the 
graph  was  generated  by  a single  cycle  of  the  system.  In  a 
depth-first  system,  some  path  (node,  state,  etc.)  is  selected  and 
a single  continuaton  is  attempted,  i.e.,  the  node  is  not  fully 
expanded  all  at  once.  This  path  continues  growing  until  either 
the  path  reaches  a solution  or  some  path-length  constraint  is 
violated.  In  the  latter  case,  the  path  is  backed  up  to  the 
deepest  node  at  which  an  alternative  exansion  exists.  At  that 
point,  another  path  continuation  is  generated.  This  process 
continues  until  either  a s’olution  is  produced  or  the  alternatives 
that  could  produce  a solution  within  the  length  constraint  are 
exhausted.  A depth-first  strategy  can  be  more  efficient  than  a 
breadth-first  one  if  a good  technique  exists  for  ordering 
production  of  path  extensions.  Figure  3—12  shows  an  example  of 
a depth-first  strategy  combined  with  back-chaining  for  the  prior 
problem.  A maximum  path  length  4 was  used  as  a constraint,  and 
the  order  of  (inverse)  operator  application  was: 

( 1 ) n — > 2n . 

( 2 ) 2n  — > n . 
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( 3 ) n -- > 3n  + 1 . 

Each  node  has  a superscript  that  denotes  the  order  in  which 
the  nodes  were  generated. 

Additional  references  include  the  following:  [Nilsson,  80; 

Klahr,  78;  Miller,  73] . 
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FIGURE  3.12 


depth-first  back  rHATMTfjf; 
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3.3.2  Methods  of  Implementing  the  CE 

Mo  s t me  thods  and  techniques  used  to  i mp  1 erne  n t a CE  are 
intimately  connected  to  the  choice  of  a representation  technique 
for  the  KB.  However,  there  are  a few  methods  that  are  general 
enough  to  be  used  with  a variety  of  KB  representations.  Two 
classes  of  them  are:  search  methods  and  mode  1 i ng/ s imu  1 a t on 

methods  [Feigenbaum,  81].  The  third  widely  used  technique  is 
pattern-matching  [Kanal,  68]. 

These  techniques  will  be  addressed  in  a future  report. 

3 . 4 Th  e Interface 

The  interface  component  of  a KBS  provides  the  necessary 
connections  and  communications  with  the  environment  and  user. 
It  is  not  always  engineered  as  a separate  module  in  the  system; 
usually  it  is  integrated  into  the  CE  and  accesses  the  KB  [Davis, 
76]  . 


The  interface  has  three  logical  parts:  the  user  interface, 
the  expert  interface,  and  the  external  data  interface. 
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3.4.1  The  User  Interface 

The  user  interface  is  the  most  important  component  of  a KBS 
in  determining  its  acceptability  to  the  practitioners  of  the 
intended  domain.  In  general,  they  are  neither  computer  scientists 
nor  programner s , and  may  view  the  computer,  especially  a KBS,  as 
a feared  and  unworthy  competitor.  A properly  functioning  user 
interface  will  smooth  out  and  minimize  the  problems  associated 
with  learning  any  new  system,  and  in  the  long  run  improve  system 
productivity  by  making  it  possible  for  the  users  to  be  more 
cooperative  in  problem-solving  activities. 

In  order  to  qualify  as  a KBS,  the  user  interface  must,  at  a 
minimum,  be  interactive  and  use  domain-specific  jargon.  The 
reason  for  requiring  the  system  to  be  interactive  is  simply  that 
the  state  of  the  art  does  not  provide  techniques  for  going  from 
problem  statement  to  "best**  answer  without  additional  information 
that  must  be  solicited  from  the  user.  The  problem  with  providing 
initially,  along  with  the  problem  statement,  all  information  that 
might  conceivably  be  needed,  is  that  most  of  it  is  unnecessary. 
Another  reason  for  wanting  a KBS  to  be  interactive  is  so  that 
explanations  of  system  behavior  and  results  can  be  solicited. 

Besides  using  doma  in— spec i f i c jargon,  many  KB  systems  accept 
and  output  information  using  an  English-like  natural  language. 


! DBMS.  NAS  A/ RECON- 5 I 


76 


I KNCWLEDGE-BASED  I 


I N A S A I 


I N A S A I 


Much  of  the  ambiguity  of  natural  language  can  be  eliminated  when 
the  dialog  is  restricted  to  a particular  domain  and  it  is  known 
that  the  user  is  engaged  in  goa l~or i ented  probl em— s o 1 v i ng 
activity. 

Another  desirable  characteristic  of  the  user  interface  is 
soft  failure.  That  is  a ICBS  should  not  blow  up  because  the  user 
makes  a mistake,  nor  should  it  conceal  its  problem.  A useful 
technique  to  smooth  over  some  problems  of  this  sort  is  a spelling 
corrector  . 

One  of  the  problems  confronting  the  explanation  mechanism  in 
the  user  interface  i s t r ans 1 at i ng  explanations  into  a natural 
form  for  the  user.  Fortunately,  the  complexity  of  this  task  is 
substantially  reduced  by  uniformities  of  format  in  the  KB  and  in 
the  workspace.  For  example,  in  a production  system,  it  is 
straightforward  to  turn  an  IF-THEN  rule  out  in  reasonable 
English.  The  usual  approach  is  to  have  a separate  scheme  for 
each  kind  of  knowledge  chunk  in  the  KB  and  element  in  the 
workspace;  most  such  schemes  look  like  sophisticated 
f i 1 1 — i n— t he— b 1 ank  formulae. 

3.4.2  The  Expert  Interface  and  Knowledge  Acquisition 

The  expert  interface  is  the  mechanism  through  which 
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knowledge  is  added  to  the  KB  or  the  KB  is  modified.  Its  intended 
users  are  experts  in  the  problem  domain  and  the  system 
implementors  who  are  responsible  for  building  the  initial  KB. 
This  interface  is  often  called  a knowledge  acquisition  interface 
[Barnett,  75].  Unlike  the  user  interface,  it  can  be  assumed  that 
the  user  of  the  expert  interface  has  some  knowledge  and  awareness 
of  the  structure  and  functioning  of  the  KBS.  Table  3-1 
summarizes  the  knowledge-acquisition  process. 

The  knowledge  that  goes  into  a KBS  must  originate  from  some 
external  source.  The  most  usual  is  an  expert  in  the  problem 
domain.  He  can  provide  specific  facts,  rules  of  thumb,  and  the 
rules  of  reasoning,  along  with  his  rating  of  confidence.  Other 
originating  sources  of  knowledge  comnonly  used  are  journal 
articles,  texts  and  engineering  handbooks.  The  information  from 
these  sources  often  is  hard  data  and  tabular.  Therefore,  it 
usually  comprises  fact  files  in  the  KB. 
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ORIGINATING  SOURCE 

Domain  Expert  (or  User) 

Journa 1 s 
Texts 

Protocol  Studies 
Derived  Results 

ENTERED  BY 

Domain  Expert 
Imp  1 emen  t o r 
User 
CE 

COMPILED  BY 

Knowledge  Acquisition  Interface 
Imp  1 emen  t o r 

ISSUES 

Interface  Language 
Cons i s t ency 
Acconxnodat  ion 
Confidence  Factors 

MA.JOR  OUTSTANDING  PROBLEMS 

Knowledge  Acquisition 

Learning 

Extensibility 


TABLE  3-1 
(Based 


KNCWLEDGE  ACQUISITION 
on  [Hayes-Roth,  83]) 
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Ideally,  the  knowledge-acquisition  interface  can  be 
used  by  domain  experts  and  users  of  the  system  other  than 
the  implementation  staff.  However,  in  many  KB  systems,  the 
complexities  of  adding  to  or  modifying  the  KB  are  such  that 
progranming  skills  are  required.  For  such  systems,  a 
computer  specialist  may  need  to  act  as  an  intermediary 
between  the  originating  source  and  the  KBS. 

The  knowledge-acquisition  interface  has  three  major 
tasks  : 

(1)  Accepting  knowledge  in  external  format  and  translating 
it  into  internal  format. 

(2)  Validating  consistency  of  new  and  old  knowledge. 

(3)  Storing  knowledge  into  the  KB.  This  is  called 

Comp  i 1 a t i on . 

4.  APPLICATION  CONSIDERATIONS  [Buchanan,  75;  Nilsson,  80] 

Though  there  exists  a relatively  diverse  collection  of 
existing  and  developing  KBS  applications,  the  selection  process 
for  each  new  application  requires  consideration  of  a variety  of 
issues.  First,  there  is  a set  of  initial  considerations  that 
address  the  issues  of  the  problem  domain  itself  and  the  people 
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associated  with  it,  the  experts  and  the  practitioners.  Next,  are 
the  technology  considerations  that  focus  on  the  availability  of 
usable  technology  for  implementing  a KBS  that  has  successfully 
met  the  first  criterion.  Last,  there  are  the  equally  important 
considerations  that  are  directed  at  determining  whether  or  not 
the  development  environment  and  the  user  environment  are  properly 
support i ve . 

Each  of  these  groups  is  considered  below  in  the  form  of  a 
set  of  questions  [Buchanan,  75]. 


4.1  Initial  Considerations 

(1)  Does  the  problem  have  a closed— form  solution? 

(2)  Is  there  an  expert  who  knows  how  to  solve  problem? 

(3)  Is  there  an  expert  available  and  can  he  work  on  the 
development  of  a KBS? 

(4)  Does  the  expert  have  a model  to  solve  the  problem? 

(5)  Is  the  domain  well  bounded? 

(6)  Are  the  intended  users  professionals? 

(7)  Are  the  economics  right? 
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4.2  Technology  Considerations 

/ 

(1)  Can  a first-order  model  (simulation)  be  constructed 
with  the  help  of  expert(s)? 

(2)  Is  there  a knowledge  representation  that  matches  the 
"•chunk  size”  of  the  expert’s  knowledge? 

(3)  What  are  the  necessary  knowledge  source(s)  and  their 
representation(s)? 

(4)  What  reasoning  or  inference  methods  are  needed? 

(5)  Are  the  knowledge  representation  and  reasoning  method 
compatible  with  one  another? 

(6)  Will  the  system  support  growth? 

4.3  Environmental  Considerations 

(1)  Is  there  an  interactive  system  for  the  KBS  users? 

(2)  Do  the  necessary  tools  exist,  in  particular  a properly 
expressive  progranming  system? 

(3)  Will  the  resultant  system  perform  effeclently? 
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5.  CONCLUSIONS 

The  technology  of  knowledge-based  systems  has  emerged  from 
the  laboratory,  but  it  has  not  achieved  the  status  of  being  a 
comnonly  known  way  of  implementing  computer-based  application 
systems.  Systems  have  been  developed  in  an  intriguing  spectrum 
of  application  areas,  from  medicine  and  chemistry  to  geology  and 
business.  The  general  level  of  accomplishment  appears  to  be  high 
enough  to  make  it  worthwhile  to  begin  exploring  other  areas  for 
immediate  potential  application. 

There  remain  a number  of  unresolved  issues.  Even  with  a 
group  of  domain  experts  who  are  cooperative  and  well  motivated, 
the  methodology  for  transferring  their  knowledge  to  the  system 
is,  at  best,  ad  hoc.  This  is  the  area  in  which  more  research  is 
needed  to  discover  (or  convert)  what  amounts  to  a completely  new 
technology:  the  acquisition,  communication,  and  representation  of 
^jxper t i se  (the  ability  to  use  a body  of  knowledge  effectively  in 
solving  a particular  problem). 
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APPENDIX  A.  A KBS  CASE  STUDY  (MYCIN) 

MYCIN  is  a medical  consultation  system.  The  material 
covered  here  is  a condensation  of  [Shortliffe  76;  Shortliffe  75; 
Davis,  77;  Davis,  76]. 

The.  Problem  Doma  i n And  The  Users 

MYCIN  is  a knowl  e dg e- ba s ed  interactive  computer  system 
intended  to  provide  advice  to  physicians  on  prescribing 
antimicrobial  therapy'  for  bacterial  infections  of  the  blood 
(bacteremia).  The  problem  of  therapy  selection  and 
reconmendat ion  for  an  infectious  disease  is  difficult  and 
complex.  The  first  is  to  determine  whether  or  not  the  infection 
is  serious  enough  to  warrant  treatment.  If  it  is  determined  that 
treatment  is  warranted,  one  should  know  what  organism  is  causing 
the  infectious  disease.  To  do  this,  one  must  obtain  a specimen 
of  the  infection  for  culturing,  analysis,  and  identification  by  a 
laboratory.  This  is  a time  consuming  process.  And  in  many 
cases,  the  infection  is  serious  enough  that  treatment  must  be 
begun  before  all  of  the  analysis  can  be  completed.  Therefore, 
any  reconmended  therapy  must  be  based  on  incomplete  information. 
To  further  complicate  matters,  the  most  effective  drug  against 
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the  suspected  or  identified  organi sm  may  be  totally  inappropriate 
for  the  specific  patient  because  of  age  or  medical  conditions  and 
problems.  Thus,  any  system  or  consulting  physician  must  be  aware 
of  all  of  these  complexties  if  proper  advice  is  to  be  rendered  in 
each  specific  case.  MV^CIN  has  been  designed  to  cope  with  just 
such  complexities  and  interrelationships  among  the  many  variables 
and  to  provide  a phy s icianwith  advice  that  is  proper  for  each 
individual  patient. 

Though  the  problem  is  quite  complex,  the  domain  is  well 
bounded.  MYCIN  requires  knowledge  related  only  to  infectious 
diseases,  and  knowledge  related  to  experience  with  various 
infectious  organisms  in  terms  of  resistance  to  specific  drugs, 
and  knowledge  of  symptoms  related  to  specific  infections. 

MYCIN  is  intended  to  be  used  by  physicians.  The  dialogue 
that  it  carries  on  with  the  user  is  in  the  jargon  of  medicine  and 
specifically  that  of  infectious  diseases,  laboratory  procedures, 
infectious  organisms,  drugs,  etc.  Thus,  a user  is  expected  to  be 
a competent  medical  practitioner. 

MICIN'S  Knowledge 

MYCIN* s knowledge  base  (KB)  contains  several  knowledge 
sources  - production  rules,  clinical  parameters,  special 
functions,  and  procedures  for  therapy  selection. 
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Each  production  rule  consists  of  a Premise,  which  may  be  a 
condition  or  a conjunction  of  conditions,  an  Action  to  be  taken, 
and  sometimes  an  Else  clause.  For  the  action  to  be  taken,  each 
of  the  conditions  in  the  Premise  must  hold.  If  the  truth  of  the 
P r emi  se  cannot  be  ascertained  or  the  Pr  emi  se  is  false,  the  action 
in  the  Else  clause  is  taken  if  one  exists;  otherwise,  the  rule  is 
ignored.  In  addition,  the  strength  of  each  rule’s  inference  is 
specified  by  certainity  factor  (CF)  in  the  range  -1  to  +1.  CF’s 
will  be  discussed  in  the  next  section.  Each  rule  inMYCIN  falls 
into  one  and  only  one  of  the  following  categories: 


(1)  Rules  that  may  be  applied  to  any  culture. 

t 

(2)  Rules  that  may  only  be  applied  to  current  cultures. 

(3)  Rules  that  may  be  applied  to  current  organisms. 

(4)  Rules  that  may  be  applied  to  any  antimicrobial  agent 
administered  to  combat  a specific  organism. 

(5)  Rules  that  may  be  applied  to  operative  procedures. 

(6)  Rules  that  are  used  to  order  the  list  of  possible 
therapeutic  reconxnendat  i ons  . 

(7)  Rules  that  may  be  applied  to  any  organism. 
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(8)  Rules  that  may  be  applied  to  the  patient. 

(9)  Rules  that  may  be  applied  to  drugs  given  to  combat 

prior  organi sms  . 

(10)  Rules  that  may  be  applied  only  to  prior  cultures. 

(11)  Rules  that  may  be  applied  only  to  organisms  isolated 

in  prior  cul tures  . 

(12)  Rules  that  store  information  regarding  drugs  of 

cho ice. 

The  system  also  contains  a collection  of  clinical 
parameters,  represented  as  <attribute,  object,  value>  triples. 
These  clinical  parameters  fall  into  six  categories: 


(1)  Attributes  of  cultures. 

(2)  Attributes  of  administered  drugs. 

(3)  Attributes  of  operative  procedures. 

(4)  Attributes  of  organisms. 

(5)  Attributes  of  the  patient. 

(6)  Attributes  of  therapies  being  considered 


for 
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reconmenda t ion. 

Each  of  the  parameters  has  a certainty  factor  reflecting  the 
system’s  "belief”  that  the  value  is  correct  and  an  associated  set 
of  properties  that  is  used  during  consideration  of  the  parameter 
for  a given  context.  These  properties  specify  such  things  as  the 
range  of  expected  values  a property  may  have,  the  sentence  to 
transmit  to  the  user  when  requesting  data  from  him,  the  list  of 
rules  whose  Premise  references  the  parameter,  the  list  of  rules 
whose  Action  or  Else  clause  permits  a conclusion  to  be  made 
regarding  the  parameter,  etc.  Only  those  properties  that  are 
relevent  to  each  parameter  are  assocated  with  it.  However, 
properly  specifying  how  the  parameter  is  to  be  represented  in 
English  is  mandatory  for  all. 

Ad  ditional  info  rma  tion  is  contained  in  si  mp  le  lists  that 
simplify  references  to  variables  and  optimize  knowledge  storage 
by  avoiding  unnecessary  duplication.  These  lists  contain  such 
things  as  the  names  of  organisms  known  to  the  system  and  the 
names  of  normally  sterile  and  non-sterile  sites  from  which 
organisms  are  isolated. 

In  conjunction  with  a set  of  four  special  functions,  MifCIN 
uses  knowledge  tables  to  permit  a single  rule  to  accomplish  a 
task  that  would  otherwise  require  several  rules.  The  knowledge 
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tables  contain  a record  of  certain  clinical  par ame ters  and  the 
values  they  may  take  on  under  various  circumstances. 

There  is  one  knowledge  source  in  MYCIN  that  is  as  a set  of 
functions.  This  is  the  knowledge  required  for  choosing  the 
apparent  first-choice  drug  to  be  recommended. 

This  constitutes  the  majority  of  MYCIN*s  knowledge  base, 
which  permits  the  system  to  comprehend  the  nature  of  an  infection 
without  complete  information  about  the  organism  involved  and 
provide  the  physician  with  proper  advice  regarding  treatment 
under  the  circumstances.  This  organization  and  structure,  along 
with  the  way  the  knowledge  is  used  facilitates  the  system^s 
ability  to  explain  its  actions  and  advice. 

MYCIN*  s Cogni X iye  Engine 

MYCIN* s cognitive  engine  is  domain  independent  in  the  sense 
that  none  of  the  knowledge  required  to  proide  advice  about 
bacteremia  is  embedded  in  it.  Thus,  additional  rules  concerning 
infectious  disease  may  readily  be  added,  or  a new  knowledge  base 
could  be  substituted  to  provide  therapeutic  advice  about  a 
different  domain  of  infections. 

The  task  that  MYCIN  performs,  under  the  control  of  its  CE, 
can  be  characterized  as  a four-step  decision  process: 
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(1)  Decide  which  organisms,  if  any,  are  causing 

significant  disease. 

(2)  Determine  the  likely  identity  of  the  significant 
organi sms  . 

(3)  Decide  which  drugs  are  potentially  useful. 

(4)  Select  the  best  drug  or  drugs. 

A consultation  session  between  a physician  and  MYCIN  results 
from  a simple  two  step  procedure: 

(1)  Create  the  patient  "context”  as  the  top  node  in  the 
context  tree. 

(2)  Attempt  to  apply  the  "goal-rule”  to  the  newly  created 
context . 

The  "goal-rule"  is  one  of  the  rules  from  the  category  of 
those  that  may  be  applied  to  the  patient  (as  described  above), 
and  states:  "If  there  is  an  organism  that  requires  therapy  and 

consideration  has  been  given  to  the  possible  existence  of 
additional  organisms  requiring  therapy,  even  though  they  have  not 
been  recovered  from  any  current  cultures,  then  do  the  following: 
Compile  a list  of  possible  therapies  which,  based  upon 
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sensitivity  data,  may  be  effective  against  the  organisms 
requiring  treatment  and  determine  the  best  therapy  reconrnended 
from  the  compiled  list;  otherwise,  indicate  that  the  patient 
does  not  require  therapy.” 

This  rule  follows  the  four— stage  decision  process  given 
above . 

The  two  components  or  programs  that  constitute  MYCIN’ s CE 
are  called  \DNITOR  and  FINOOUT.  ^DNlTOR’s  function  is  to 
determine  whether  the  conditions  stated  in  the  Premise  of  a rule 
are  true.  To  do  so,  it  considers  each  condition  of  the  Premise 
at  hand,  first  determing  whether  it  has  all  of  the  necessary 
information  to  make  the  determination.  If  it  requires 
information,  it  calls  FINDOUT  to  obtain  what  is  needed.  FIJ®OUT 
first  determines  whether  the  needed  information  is  laboratory 
data.  If  it  is,  it  asks  the  physician  for  it.  If  the  physician 
cannot  provide  it,  FINDOUT  retrieves  the  list  of  rules  that  may 
aid  in  deducing  the  information  and  calls  MONITOR  to  evaluate  the 
rules.  When  the  process  completes,  control  is  returned  to 
MDNITOR.  If  the  information  needed  is  not  laboratory  data, 
FINDOUT  retrieves  the  list  of  rules  that  may  aid  in  deduci ng  the 
needed  information  and  calls  MDNITOR  to  evaluate  the  rules.  If 
the  deductive  process  of  applying  the  rules  (backward  from  a goal 
to  the  data  or  information  needed)  cannot  provide  the  needed 
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information,  the  physician  is  asked  to  provide  it.  In  either 
case,  control  is  returned  to  M)N I TOR . Given  the  info r ma tion  that 
is  provided  by  FINDOUT  or  that  was  already  available,  NONITOR 
determines  whether  the  entire  Premise  is  true.  If  it  is  not,  and 
there  is  no  Else  clause,  the  rule  is  rejected.  If  the  Premise  is 
true  or  the  Else  clause  is  invoked,  the  conclusion  stated  in  the 
Action  of  the  rule  or  in  the  Else  clause  is  added  to  the  ongoing 
record  of  the  consultation,  and  the  process  completes.  Note  that 
there  is  a recursive  relationship  between  MONITOR  and  FINDOUT, 
such  that  so  long  as  any  information  is  needed  to  evaluate  a 
Premise,  or  rules  are  required  to  develop  the  needed  information, 
the  two  components  are  in  a recursively  dependent  and  oscillating 
relationship  until  the  very  first  rule  invoked,  the  ”goa 1 -r u 1 e ” , 
is  satisfied.  In  the  process  of  evaluating  the  rules,  a great 
deal  of  related  and  necessary  info  rma  tion  and  data  are  developed 
and  retained  in  various  tables  and  structures  in  the  wo r k s p a c e . 
They  serve  two  purposes: 

(1)  They  prevent  wasted  effort  that  would  be  required  to 
redevelop  information  that  has  already  been  obtained, 
and  to  prevent  the  system  from  endlessly  chasing  its 
tail. 

(2)  They  provide  the  necessary  history  required  for  the 
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explanations  that  may  be  requested  by  the  user. 

In  addition  to  having  certainty  factors  (CFs)  for  the  rules 
and  the  clinical  parameters  in  the  knowledge  base,  the  physician, 
when  asked  for  either  laboratory  data  or  other  information  that 
the  system  itself  cannot  deduce,  may  attach  a CF  to  his  input. 
The  default,  if  the  physician  does  not  provide  a CF,  is  assumed 
to  be  +1.  The  certainty  factors  are  the  key  to  permitting  MYCIN 
to  perform  inexact  reasoning.  The  rationale,  mathematics,  and 
application  are  thoroughly  treated  in  [Shortliffe,  76].  The 
presentation  here  is  very  simplified. 

A certainty  factor  (CF)  is  a number  between  -1  and  +1  that 
reflects  the  degree  of  belief  in  a hypothesis.  Positive  CFs 
indicate  that  there  is  evidence  that  the  hypothesis  is  valid;  the 
larger  the  CF,  the  greater  the  degree  of  belief.  A CF  = 1 
indicates  that  the  hypothesis  is  known  to  be  correct.  A negative 
CF  indicates  that  the  hypothesis  is  invalid;  CF  = -1  means  that 
the  hypothesis  has  been  effectively  disproven.  A CF  = 0 means 
either  that  there  is  no  evidence  regarding  the  hypothesis  or  that 
the  evidence  is  equally  balanced.  The  hypotheses  in  the  system 
are  statements  regarding  values  of  clinical  parameters  for  the 
nodes  in  the  context  tree.  To  properly  perform,  MYCIN  must  deal 
with  competing  hypotheses  regarding  the  value  of  its  clinical 
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parameters.  To  do  so,  it  stores  the  list  of  competing  values  and 
their  CFs  for  each  node  in  the  context  tree.  Positive  and 
negat ive  CF s are  a c c umu lated  separately  as  me asures  of  belief 
(mb)  and  measures  of  disbelief  (MD)  and  added  to  form  a resultant 
CF  for  a clinical  parameter.  The  CF  of  a conclusion  is  the 
product  of  the  CF  of  the  rule  that  generated  the  conclusion  and 
the  tally  of  the  CFs  of  the  clinical  parameters  that  were  used  in 
substantiating  the  conclusion.  When  a second  rule  supports  the 
same  conclusion,  the  CFs  are  combined  by  z = x + y(l-x),  where  x 
is  the  CF  of  the  first  supporting  rule,  y is  the  CF  of  the 
succeeding  rule  and  z is  the  resultant  CF  for  the  conclusion. 
The  CFs  permit  the  system  to  report  f indings  to  the  physician 
with  varying  degrees  of  certainty  such  as,  "There  is  strongly 
suggestive  evidence  that  "There  is  suggestive  evidence 
that  ....",  "There  is  weakly  suggestive  evidence  that  ....",  etc. 

Cont ext  Tree ♦ The  topmost  tree  is  always  the  patient. 
Branches  are  added  successively  to  the  existing  nodes  as  FINDOUT 
discovers  a need  for  them  in  attempting  to  obtain  requested 
information,  for  MONITOR.  Thus,  given  only  the  patient,  when 
MONITOR  requests  information  from  FINDOUT  about  organisms  in 
order  to  evaluate  the  first  condition  in  the  Premise  of  the 
goal-rule,  FINDOUT  discovers  that  it  cannot  get  organism 
information  without  having  information  about  cultures.  Thus, 
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context(s)  concerning  cultures(s)  are  spawned  from  the  patient 
node,  from  which  eventually  are  spawned  contexts  for  the 
organisms  identified  by  the  cultures.  For  those  organisms  deemed 
significant,  links  attach  to  context  nodes  about  the  relevant 
drugs  for  treating  these  organisms.  Thus,  the  context  tree  is 
tailored  for  each  patient  as  the  system  progresses  through  its 
reasoning  process. 

MyCIN*  S Explanat ions 

One  of  the  primary  design  consideration  taken  in  MifCIN  was 
the  requirement  that  the  system  be  able  to  explain  its  decisions 
if  physicians  were  going  to  accept  it.  Selecting  rules  as  the 
representation  of  the  system’s  knowledge  greatly  facilitated  the 
implementation  of  this  capability.  The  physician  using  the 
system  enters  the  explanation  subsystem  automatically  when  the 

•i. 

consultation  phase  is  completed,  or  he  may  enter  it  upon  demand 
during  the  consultation  session  at  any  point  at  which  the  system 
requests  input  from  him.  In  the  latter  case,  he  can  input 
to  request  a detailed  answer  about  the  question  just  asked  of  him 
or  he  can  input  ”QA'*  to  enter  the  general  question-answering 
explanation  subsystem  to  explore  the  decisions  and  other  aspects 
of  the  consultaion  up  to  the  point  of  divergence. 

The  explanation  provides  several  options  to  the  physician. 
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Since  the  system  automatically  enters  this  mode  at  the  end  of  the 
consultation,  the  physician  may  simply  input  "STOP”,  which 
terminates  the  system.  He  may  input  "HELP”,  which  provides  him 
with  the  list  of  explanation  options,  which  include: 


I nput 
EQ 


PR 

IQ 


Op  t i on 

Explain  a specific  question  asked  of  the 
physician  during  the  consultation  - each  has  a 
sequence  number,  which  must  accompany  the  EQ 
request . 

Requests  a particular  rule  be  printed  and  must  be 
followed  by  the  rule  number. 

Is  a prefix  for  a question  about  information 
acquired  by  the  system  during  the  consultation. 
The  question  is  phrased  in  the  limited  English 
that  MSfCIN  can  handle. 


no  prefix  A general  question  is  assiuned  being  asked  about 
the  content  of  MYCIN’s  rules. 


Thus,  the  physician  can  ask  to  have  Question  48  explained  by 
inputting  ”EQ48”.  To  which  the  system  would  respond:  QUESTION 

48  WAS  ASKED  IN  ORDER  TO  FIND  OUT  THE  PATIENT’S  DEGREE  OF 
SICKNESS  (ON  A SCALE  OF  4)  IN  AN  EFFORT  TO  EXECUTE  RULE068.  He 
may  then  optionally  input  "PReS”  or  ”VMAT  IS  RULE068”  to  see  what 
exactly  was  being  sought  and  why. 

MyCIN*  S Interfaces 

MYCIN  has  two  interfaces.  One  is  for  the  using  physician. 
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through  which  he  may  answer  questions  posed  by  the  system  and  ask 
questions  of  it;  the  other  is  a knowledge-acquisition  interface 
accessible  only  to  experts  recognized  as  such  by  the  system. 

All  of  the  questions  asked  of  the  user  have  been  carefully 
designed  not  to  require  the  language-understanding  component. 
Thus,  instead  of  asking,  ”What  is  the  infectious  disease 
diagnosis  for  the  patient?”  it  asks,  ”Is  there  evidence  that  the 
patient  has  a meningitis?”  To  which  only  a simple  ”yes”  or  ”no” 
i s requi red . 

The  knowledge-acquisition  interface,  on  the  other  hand, 
permits  the  expert  to  input  a new  rule  in  stylized  English,  with 
prompting  to  obtain  the  rule  'in  the  proper  sequence:  Premise 
first,  condition  by  condition,  followed  by  the  Action,  and  then 
an  Else  clause  if  one  is  required.  The  system  then  translates 
the  rule  into  internal  form,  reordering  the  conditions  of  the 
Premise  if  necessary,  according  to  a set  of  criteria  developed  to 
improve  the  rule-evaluation  process.  It  then  retranslates  the 
rule  into  English  and  requests  that  the  expert  decide  whether  the 
rewritten  version  was  the  one  intendend.  If  not,  the  expert  may 
modify  selected  parts  and  is  not  required  to  restate  the  entire 
rule  unless  there  has  been  a gross  misunderstanding. 

The  same  mechanism  is  used  when  an  expert  wants  to  correct 
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or  modify  an  existing  rule.  In  all  cases,  when  a new  or 
corrected  rule  has  been  approved  by  the  expert,  the  system  checks 
to  see  whether  the  rule  is  consistent  with  the  existing  rule  set. 
If  the  new  or  modified  rule  subsumes  or  is  subsumed  by  an 
existing  rule,  it  is  not  readily  discoverable,  and  no  test  is 
made  for  this  condition.  If  a rule  is  discovered  to  be  in 
conflict  with  an  existing  rule,  it  is  rejected. 
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ABSTRACT 

The  currently  developed  user  language  interfaces  of 
information  systems  are  generally  for  experienced  users.  These 
interfaces  c onxno nly  ignore  potentially  the  largest  user  group, 
namely,  causual  users.  This  project  discusses  the  concepts  and 
implementations  of  a natural  query  language  system  which  satisfy 
the  nature  and  information  needs  of  causual  users  by  allowing 
them  to  communicate  with  the  system  in  the  form  of  their  native 
language.  In  addition,  a fr ame wo rk  for  the  develo pme nt  of  such 
an  interface  is  also  introduced  for  the  MADAM  (Multics  Approach 
to  Data  Access  and  Management)  system  at  the  University  of 
Southwes  tern  Louisiana. 
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CONCEPTS  AND  IMP LE2VIENTAT IONS 
OF 

NATURAL  LANGUAGE  QUERY  SYSTBVtS 

1 . THE  IMPORTANCE  OF  NATURAL  LANGUAGE  QUERY  SYSTEMS 

The  major  function  of  a computerized  information  system  is 
to  enable  its  users  to  retrieve  and  modify  any  subset  of  the  data 
in  the  data  bases,  as  well  as  to  provide  support  to  its  users  in 
their  decision-making  activities.  In  other  words,  the 
computerized  information  system  is  developed  to  serve  its  users 
and  satisfy  their  inmediate  needs  for  information.  Thus,  the 
success  or  failure  of  an  information  system  is  ultimately  decided 
by  the  users  the  system  is  supposed  to  serve. 

The  predominant  criterion  in  evaluating  an  information 
system,  from  the  user’s  viewpoint,  is  whether  the  system  allows 
him  to  freely  conmunicate  to  it  and  satisfy  his  needs.  Therefore, 
the  interface  problem  in  user-system  interaction  must  be 
seriously  considered  while  developing  an  information  system.  The 
concept  of  a multi-user  query  system  is,  therefore,  applied  in 
the  development  of  most  information  systems  to  allow  different 
user  groups  to  conmunicate  with  the  system  by  using  specific  data 
base  sublanguages.  But,  these  multi-user  query  systems  all  too 
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often  ignore  the  nature  of  the  largest  group  of  the  user 
population  casual  users. 

Casual  users,  as  defined  in  [Codd,  74]  are  ones  **whose 
interactions  with  the  system  are  irregular  in  time  and  motivated 
by  (their)  jobs  or  social  roles.”  Such  users  may  not  only  lack 
knowledge  about  computers,  programming,  logic,  or  relations,  but 
also  are  not  willing  to  learn  an  artificial  language.  The  only 
query  language  which  they  are  willing  to  use  to  interact  with  a 
data  base  system  is  their  native  language. 

After  examining  the  characteristics  of  casual  users,  it  is 
conceivable  that  the  traditional  approach  of  query  language 
design,  which  assumes  that  the  users  are  willing  to  develop  the 
appropriate  skills  and  learn  the  ”u s e r- s uppor t s ” to  operate  an 
information  system,  cannot  cope  with  the  nature  of  those  casual 
users.  For  example,  Que ry-By-Examp 1 e has  been  proven  by  many 
behavioral  researches  [Greenblatt,  78;  Waxman,  78;  Zloof,  78]  to 
be  an  easy-to-use  query  language  for  non-progranmer  users.  But, 
before  a user  can  manipulate  this  language,  he  still  requires 
about  three  hours  or  four  sessions  of  instruction  and  a knowledge 
of  first-order  predicate  calculus.  In  order  to  satisfy  the 
information  need  of  casual  users,  therefore,  a natural  language 
query  system  should  be  developed  so  that  the  casual  users  can 
freely  employ  their  native  languages  to  specify  what  they  want 
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while  interacting  with  the  system. 

The  purpose  of  this  project  is  to  briefly  examine  the 
current  development  of  natural  language  query  systems,  and 
present  a framework  for  such  a system  for  the  "SEARCH”  subsystem 
of  MADAM.  Finally,  the  difficulties  involved  in  the  construction 
of  such  a query  system  will  be  evaluated  and  some  solutions  to 
those  problems  are  proposed  for  future  studies. 


2 . METHODOLOGY 

Recognizing  the  importance  of  a natural  language  query 
system,  considerable  research  has  been  performed  in  this  field 
during  the  last  decade  [Codd,  74;  Lockemann,  75;  Waltz  77; 
Goodman,  77].  This  project  intends  to  examine  these  research 
activities  and,  based  on  the  knowledge  obtained  through  the  above 
work,  to  propose  a framework  for  the  development  of  a natural 
language  query  system  within  MADAM. 

By  definition,  a "framework"  identifies  the  relationships 
between  the  parts,  and  reveals  the  areas  in  which  further 
development  will  be  required  [Spragne,  1980].  Thus,  in  this 
project,  it  is  necessary  to  examine  the  relationships  between  the 
natural  language  query  system  and  the  existing  subsystems  of  a 
database  system,  especially  the  "SEARCH"  subsystem,  as  well  as 
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the  relationships  between  various  components  in  the  natural 
language  query  system  itself.  In  addition,  issues  addressing  the 
development  of  such  a system,  such  as  the  restrictions  and  the 
reasonable  alternative  approaches  to  developing  such  a query 
system,  are  to  be  discussed. 

To  accomplish  the  above  purposes,  the  method  applied  in  this 
project  is  a library  research  approach.  The  research  proceeded  in 
the  following  five  steps: 

(1)  To  discuss  the  concepts  of  a natural  language  query 
system.  The  major  concern  lies  in  the  conceptual 
relationships  between  the  natural  language  query 
system  and  other  database  sublanguages  within  the 
database  system,  as  well  as  the  relationships  between 
components  within  a natural  language  query  system. 

(2)  To  discuss  the  implementation  of  the  above 
re  1 at ionships . 

(3)  Based  on  the  above  discussions,  to  generate  a 
framework  for  the  development  of  a natural  language 
query  system  for  MM>AM. 

(4)  To  discover  the  difficulties  involved  in  the 
d e V e 1 o pme  nt  of  the  above  syst  em . 
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(5)  To  propose  some  directions  to  solve  the  above 
p r o b 1 ems  . 


3 . CONCEPTS  OF  NATURAL  LAM5UAGE  QUERY  SYSTEMS 

The  primary  objective  of  a natural  language  query  system  is 
to  permit  casual  users  to  engage  in  effective  comnunicat ion  with 
a formatted  database  system  by  applying  their  native  language.  To 
develop  such  a query  system,  it  is  necessary  to  understand  the 
interrelationships  between  the  natural  language  query  system  and 
the  database  system,  as  well  as  the  interrelationships  between 
the  components  within  the  natural  language  query  system.  In  this, 
section,  these  relationships  are  examined,  and  the  implementation 
of  these  relationships  will  be  discussed  in  the  next  section. 

3.1  Relationships  Between  Natural  Language  Query  Systems  and  the 

Data  Base  System 

The  data  base  design  can  be  separated  into  at  least  three 
design  levels  (Figure  3-1).  The  first  level,  the  user’s  logical 
level  or  information  structure  level,  is  the  logical 
representation  of  "facts”  in  reality.  The  second  level,  data  base 
level  or  system’s  logical  level,  is  not  visible  to  the  users  and 
at  this  level,  the  logical  structuring  of  data  is  shown.  The 
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third  level  is  the  physical  storage  structure  level  where  the 
data  are  actually  structured  and  stored  in  secondary  storage. 
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FIGURE  3-1  Levels  of  Data  Base  Design  [Nijessen,  1974] 
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While  using  a query  language  to  retrieve  information  from  a 

data  base  system,  the  casual  user  is  supposed  to  know  ”what 

'fact*  he  wa  nts  to  obtain  fr  om  the  s y s t em  and  h ow  to  express  his 
intention  in  his  preferred  language”,  instead  of  kn o w i n g ” h o w t o 
access  the  data  from  the  data  base  system”.  Thus,  a good  query 
language  should  be  based  on  the  concepts  of  the  data  description 
model  and  try  to  avoid  as  many  as  possible  of  the  concepts  which 
are  machine  dependent  [Ghosh,  77].  Currently  developed  query 
languages  for  casual  users  are  mainly  of  the  form  of  restricted 
English,  such  as  SEQUEL  [Boyce,  1974]  and  QUERY- BY- EXAMPLE 
[Zloof,  1978].  Although  these  languages  have  a high  degree  of 
machine  independence,  they  are  not  ”natural”  to  casual  users 
[Greenblatt,  78;  Waxman,  78].  As  Codd  suggested,  the  only  way  to 

entice  the  casual  user  to  interact  with  a data  base  system  is  to 

permit  him  free  use  of  his  native  language.  Therefore,  the 
development  of  a natural  language  query  system  is  necessary  and 
important.  The  following  discussion  explains  that  the  development 
of  such  a query  system  that  relates  to  an  existing  data  base 
system  is  possible  by  extending  the  concept  of  the  hierarchy  of 
user  1 anguage  s . 

/ 

3.2  Hierarchy  of  User  Languages 

The  hierarchy  of  data  base  interfaces,  as  presented  in 
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Kraegeloh*s  description  [Kraegeloh,  75],  can  be  defined  as 
foil ows  : 

(1)  Each  interface  is  defined  in  terms  of  a lower 
interface,  and  ma y itself  serve  as  the  basis  for 
definition  of  a higher  interface. 

(2)  There  is  exactly  one  interface  which  cannot  be  defined 
in  terms  of  another  interface  and  hence  serves  as  the 
u 1 1 i ma  tebasis  for  all  other  interfaces. 

Following  the  above  definition,  [Lockemann,  75]  introduced 
some  general  rules  on  the  design  of  user  languages.  He  claimed 
that,  keeping  to  those  rules,  a new  interface  can  be  defined  in 
terms  of  its  immediate  predecessor,  and  at  any  level  of  the 
hierarchy,  a user  can  formulate  his  queries  without  the  necessity 
of  knowing  the  language  existing  in  the  lower  levels. 

Based  on  their  concepts,  it  is  obvious  that  one  possible 
step  of  abstraction  is  the  definition  of  a new  interface  level 
which  accepts  natural  language  as  input.  To  this  new  interface, 
the  existing  high  level  query  language  such  as  SEQUEL  becomes  the 
inmediate  predecessor.  This  query  language,  acting  as  the 
intermediate  of  the  natural  language,  translates  the  natural 
language  input  into  a formal  query  language,  processes  it  down  to 
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the  lowest  level  of  the  hierarchy,  and  then  translates  the 
results  or  responses  into  the  natural  language  acceptable  to  the 
user. 

3.3  Development  of  Natural  Language  Query  Systems 

The  above  discussion  claims  that  a natural  language  query 
system  is  possible  to  be  developed  on  the  existing  hierarchy  of 
user  languages.  Some  systems  that  support  natural  language  have 
already  been  developed  both  in  the  DBMS  and  AI  research  fields, 
such  as  RENDEZA/^OUS , LUNAR,  ELIZA  and  PLANES.  The  major  difference 
among  those  systems  lies  in  the  emphasis  on  the  type  of  dialogue 
which  the  system  uses  to  communicate  with  its  users.  Those  types 
of  dialogue  are  as  follows  [Codd,  1974]: 

St  rol<;ing  Dialog 

In  this  approach,  wh en  the  syst em  receives  the  queries  fr om 
its  user,  it  assures  the  user  that  it  has  been  listening  to  him 
and  invites  him  to  cotinue  his  queries.  Weigenbaum’s  ELIZA  is  of 
this  type . 

Contr ibut ive  Dial og 

In  this  approach,  dialog  involves  contributive  utterances 
and  questions  about  changes  of  state  in  the  given  environment. 
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but  not  questions  about  the  meaning  of  previous  utterances. 
Winograd’s  SHURDLU  is  of  this  type. 

Clarif  icat  iioyx  Dialog 

In  this  approach,  dialog  involves  queries  about  previous 
utterances  in  the  dialog.  Codd’s  RENDEZVOUS  and  its  version  1, 
version  2 and  Waltz’s  PLANES  are  of  this  type. 

Although  there  are  some  distinctions  among  the  above 
approaches  and  systems,  the  ideas  about  the  structure  of  a 
natural  language  query  system*  which  built  up  the  user- system 
interaction  are  quite  similar  as  shown  in  Figure  3—2.  This 
diagram  shows  the  interaction  between  the  user  and  the  major 
components  of  the  natural  language  query  system,  as  well  as  the 
relationships  between  those  components. 
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FIGURE  3-2  Components  of  a Natural  Language  Query  System 
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3.4  Relationships  Between  Components  of  the  Natural  Language 

Query  System 

In  Figure  3-2,  the  relationship  of  three  major  components  of 
a natural  language  query  system  are  identified,  and  the  system 
processes  user  query  as  follows: 

(l)  The  user  initiates  his  request  in  the  form  of  his 
native  language  which  may  be  both  syntactically  and 
semantically  complete,  or  it  may  involve  certain 
ambiguity  resulting  from  syntax  errors,  incompleteness 
or  semantic  incompatibility.  After  the  analyzer  of 
the  system  language  processor  receives  the  query,  it 
first  reduces  the  redundant  words  or  phrases  in  the 
query;  then  analyzes  the  syntax  of  the  query  and  its 
s ema ntics;  third,  the  results  of  the  analysis  are  used 
to  generate  a formal  query  defined  by  the  system.  This 
formal  query  may  be  incomplete  either  syntactically  or 
semantically.  If  it  is  so,  then  the  formal  query  is 
tramsmitted  to  the  dialog  control.  The  dialog  control 
examines  the  logical  completeness  of  the  query,  and 
decides  wh at  strategy  the  syst em  should  apply  to 
conmunicate  with  the  user  in  order  to  achieve  the 
logical  completeness  of  the  formal  query. 


I N L Q S I 


I DK4S.NASA/RECON-6  I 


16 


I N A S A 1 


I N A S A I 


(2)  The  decision  is  used  to  generate  a question,  usally  in 
the  form  of  multiple-choice,  and  transmitted  to  the 
user. 

(3)  After  the  user  provides  additional  information,  the 
dialog  control  examines  the  logical  completeness  and 
repeats  the  above  procedure  until  the  objective  is 
achieved.  After  the  logically  complete  query  is 
generated,  the  data  sublanguage  statements  are 
transmitted  to  the  synthesizer, 

(4)  The  synthesizer,  after  received  the  formal  query, 
transforms  it  into  a precise  natural  language 
restatement  based  on  the  formal  query,  and  transmits 
this  restatement  back  to  the  user. 

If  the  user  approves  the  system  restatement,  then  the 
analyzer  informs  the  synthesizer  so  that  it  can  initiate  the  data 
retrieval  operations.  Otherwise,  the  above  process  will  be 
repeated  until  there  is  an  agreement  reached  between  the  user  and 
the  sy s t em. 

The  next  part  in  this  section  explains  the  functions  of  each 
component  involved  in  this  four— step  process. 
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3.4.1  The  Analyzer 

The  analyzer  performs  three  major  functions:  first,  it 

translates  as  mu ch  as  possible  of  the  user’s  query  into  a data 
base  language;  second,  it  discovers  and  analyzes  the  translation 
difficulties  such  as  the  ambiguity  involved  in  the  query,  as  well 
as  generates  sufficient  parameters  to  enable  the  dialog  control 
to  piece  together  dialog  appropriate  to  the  state  of  translation 
and  the  state  of  the  user  interaction;  finally,  it  provides 
interpretation  of  the  user’s  response. 

The  way  an  analyzer  performs  the  above  functions  is  based  on 
the  technique  of  the  implementation.  In  general,  there  are  two 
consecutive  operations  involved  in  the  analyzer:  parsing  and 

interpretation.  In  the  parsing  phase,  the  user’s  request  is 
transformed  into  normalized  form  by  reducing  the  redundant  words 
or  phrases.  In  the  interpretation  phase,  the  feature  and  value 
representation  of  the  user’s  request  is  translated  into  the 
formal  query  language,  which  then  will  be  used  to  proceed  to  the 
actual  information  retrieval  activity. 

3.4.2  The  Dialog  Control 

The  dialog  control  provides  a base  for  experimentation  with 
dialog  styles  and  tactics.  For  example,  it  is  the  mechanism  to 
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express  how  fully  the  user  is  kept  informed  of  the  system’s 
progress  in  understanding  his  input  and  what  type  of  dialog  the 
system  should  generate  in  responding  to  the  user’s  query. 

The  decisions  on  the  construction  of  ”re-s tatement ” or 
”pa r 3“phr a s e ” feedback  to  the  user  are  the  operations  involved  in 
this  c omp o n e n t . Th is  feedback  ensures  that  the  further  operation 
of  the  system  will  be  consistent  with  the  user’s  intention,  or  it 
clarifies  the  segment  of  the  user’s  query  which  the  system  is 
unable  to  understand. 

3.4.3  The  Synthesizer 

The  synthesizer  is  responsible  for  translating  the  system’s 
response,  a restatement  or  the  answer,  back  into  natural  language 
from  the  formal  data  sublanguage. 

The  above  three  principal  components  are  fundamental  to  all 
the  natural  language  query  systems.  Therefore,  in  implementing 
such  a system,  the  implementor  has  to  ensure  that  the  system’s 
design  is  able  to  perform  the  functions  required  in  each 
component.  In  the  next  section,  the  implementation  of  two  sample 
natural  language  query  systems,  RENDEZVOUS  and  PLANES,  are 
over viewed  to  examine  the  techniques  required  in  implementing 
such  a query  system. 


I N L Q S I 


I DHviS  . NASA/  RECON-  6 I 


19 


i 


INASAI  INASAI 


4.  IMPLEMENTATION  OF  NATURAL  LANGUAGE  QUERY  SYSTEMS 

The  discussion  of  the  implementation  of  a natural  language 
query  system  in  this  project  is  to  be  divided  into  three  parts: 
first,  to  describe  the  general  rules  for  developing  such  a 
system;  second,  to  overview  a block  diagram  developed  by  Codd 
[Codd,  78]  which  includes  the  concepts  discussed  in  the  previous 
section;  and  finally,  to  discuss  the  functional  performance  of 
the  i mp  1 erne  nted  syst  ems  . 

4.1  The  General  Rules  of  the  Implementation 

In  his  ^Seven  Steps  to  Rendezvous  With  the  Casual  User”, 
[Codd,  74]  proposed  seven  steps  required  in  the  implementation  of 
a natural  language  query  system.  They  are: 

111  S_s.l  e c t i ng  jl  s imp  I e data  mode  1 whJLch  can  describe  the  data  in 
A.  xfilat  i ye  ly  -S-unpIg  way both  -s.yjitac  t jcal  ly  and  semant  ig-aHy 

The  selection  of  a data  model  is  strongly  affected  by  the 
fact  that  data  definition  would  be  performed  by  untrained 
personnel.  It  is  believed  that,  in  terms  of  the  logical  view  of 
the  data,  the  relational  data  model  is  by  far  the  most 
comprehensible  to  the  non-computer-professional  user  The 
requirement  that  all  data  be  in  tables,  with  named  field 
specifiers,  unique  keys,  and  no  multiple-valued  field  entries. 
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would  guarantee  first  normal  form  without  causing  conceptual 
difficulty  on  the  part  of  the  user.  Unlike  CODASYL  DBTG  systems, 
where  the  relationships  among  data  items  are  explicitly  stated 
via  set  relationships  and  the  data  manipulation  language  must 
navigate  ^lmong  the  sets,  in  a relational  scheme  the  data  can 
remain  simple  in  structure  and  the  complexity  can  be  buried  in 
the  access  methods  employed  by  the  software,  which  are  invisible 
to  the  user.  The  ability  of  the  relational  systems  to  create  new 
relationships  among  data  items  in  response  to  each  new  query  also 
results  in  efficient  use  of  space,  as  a complex  network  of  links 
and  pointers  does  not  have  to  be  ma  intained . 

Based  on  the  above  comparison  between  two  mainstream  data 
models,  by  selecting  the  relational  model,  the  user,  particularly 
the  casual  user,  can  be  effectively  isolated  from  the  actual  data 
base  organization,  and  this  is  also  the  ma  in  reason  that  both  the 
RENDEZVOUS  and  PLANES  systems  apply  the  relational  approach. 

l2l  SgUctlng  A iigJL  Uygl  J-Qgic  as.  the  internal  target 

In  the,  natural  language  query  system,  the  user  expresses  his 
request  by  using  potentially  poorly  formulated  language 
statements.  This  informal  query  may  be  ambiguous  and/or 
semantically  incompatible  with  the  data  base  description.  In 
order  to  enable  the  system  to  detect  those  problems,  the  user’s 
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source  statements  have  to  be  translated  into  an  internal,  precise 
language  which  is  acceptable  to  the  system.  The  data  sublanguage 
alpha,  a relational  calculus  language  [Codd,  1971],  ■ which  was 
selected  as  the  internal  target  by  both  RENDEZVOUS  and  PLANES, 
and  DEDUCE,  which  was  selected  by  RENDEZVOUS  1 and  2,  are 
ex^unples.  The  reason  for  selecting  such  a relational  calculus 
language  is  because  of  its  simplicity,  completeness, 
nonprocedura 1 i ty  and  extensibility.  Most  of  all,  ”the  ALPHA-like 
languages  provide  a coninon  core  of  features  that  will  be  required 
in  some  shape  or  form  in  all  natural  languages”  [Codd,  1974, 
1978]  . 

r. 

i_2_L  JatXQd.hg  i Ag  a .s.t.r.a.t.g.g.y  .ks.  which  the  svs  t em  can  keep  the 
^Qg  .cl  Q S g I y lied  AA  IhC  data  base  description  and  the  user’s 

Most  often,  a user's  query,  while  in  the  form  of  natural 
language,  will  omit  information  necessary  to  form  an  adequate 
query,  such  as  ellipsis,  using  pronouns  instead  of  nouns,  or 
missing  necessary  information.  There  are  many  different 
strategies  that  have  been  applied  to  allow  the  system  to  address 
these  problems.  In  RENDEZVOUS,  the  analyzer  simply  ignores  the 
incomprehensible  words,  during  the  analysis  stage,  translating 
the  remaining  comprehensible  words  into  formal  languages,  and 
piecing  them  together  to  determine  what  things  are  missing.  In 
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PLANES,  in  addition  to  the  above  strategy,  a context  register, 
the  history  keepers  which  store  all  semantic  constituents  of 
user’s  requests  and  answers  to  earlier  questions  and  other 
information,  and  concept  case  frames,  a template  representation 
of  an  entire  series  of  questions  about  the  data  base,  are  used  by 
the  analyzer.  By  applying  the  concept  of  pattern  matching,  if 
i n c omp rehens ible  wo rds  are  encountered,  the  analyzer  looks  back 
through  past  context  register  values  to  fill  in  missing  elements 
in  order  to  solve  the  above  problems,  and  to  extend  the  system’s 
ability  in  the  future  analysis  process. 

i.4)  Xnlxoduc  ing  system  r e - s t a t erne  n t of  user’s  query 

The  purpose  of  the  introduction  of  re-statement  is  to  ensure 
that  the  system  has  correctly  interpreted  the  user’s  query. 

i-S  ) Separa  t ing  que  ry  f o rmu  1 a t i on  f r om  the  data  base  search 

The  purpose  of  this  separation  is  to  protect  the  user  from 
what  may  be  expensive  searches  for  information  he  does  not  want. 

lAX  Employing  mnl t iplc-choicg  Inter rogat i on  f al 1-back 

When  a user’s  query  consists  of  certain  words  or  phrases 
which  are  incomprehensible  to  the  system  such  as  a syntax  error, 
undefined  data  item  or  record,  or  certain  misspelled  words,  and 
the  system  cannot  generate  a formal  query  without  understanding 
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them,  the  system  needs  to  form  mu  1 1 i p 1 e- c ho i c e question  as  a 
fail-back  in  order  to  prevent  further  problems  with  the 
interaction  between  the  user  and  the  system. 

Xzj.  fjPYid  iing  M.  definition  capability 

In  a non-dialog  environment,  the  user  must  observe  the  need 
for  a definition  and  supply  it  to  the  system’s  library  of 
definitions.  But  in  the  dialog  environment  of  the  natural 
language  query  system,  the  system  must  take  this  responsibility; 
it  must  detect  the  needs  for  definitions  and  extract  them  for  the 
user  . 


4.2  A Block  Diagram  of  a Natural  Language  Query  System 

By  examining  the  research  in  the  natural  language  query 
systems,  particularly  in  Lockemann’s  KAIFAS,  and  Codd’s 
RENDEZVOUS  and  its  version  1,  a block  diagram  which  presents  the 
structure  of  a natural  language  query  system  and  describes  the 
relationships  between  components  of  such  a system  can  be 
introduced  as  Figure  4-1. 
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4,2.1  Ana  1 y z e r 

The  analyzer,  as  mentioned  in  the  previous  section,  has 
three  ma jor  functions: 

(1)  To  translate  as  mu ch  as  possible  of  the  user’s  query 
into  a data  base  sublanguage. 

(2)  To  discover  and  analyze  the  translation  difficulties, 
as  well  as  generate  sufficient  parameters  to  enable 
the  dialog  control  to  piece  together  dialog 
appropriate  to  the  state  of  the  translation  and  the 
state  of  the  user  interaction. 

(3)  To  provide  interpretation  of  the  user’s  response. 
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FIGURE  4-1  A Block  Diagram  of  a Natural  Language  Query  System 
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The  way  an  analyzer  perform  these  functions  is  based  on  the 
implementation  of  the  system.  In  general,  the  operations  of  the 
analyzer  have  been  implemented  as  two  types  of  analysis,  namely, 
the  syntactical  analysis,  which  is  used  to  reduce  redundancies, 
and  the  semantic  interpretation.  For  example,  in  RENDEZVOUS,  the 
concept  of  transformational  granxnars  [Barr  81;  Feigenbaum,  81]  is 
applied  in  the  syntactical  analysis:  the  analyzer,  first,  by 
using  standard  suffix  transformations,  drops  redundant  words  such 
as  "please**  and  transforms  the  words  in  the  user’s  query  into  a 
normalized  form  independently;  then,  the  phrase  transformer 
recognizes  the  types  of  phrases  and  replaces  them  by  phrases 
which  are  syntactically  closer  to  the  formal  query  language.  In 
the  interpretation  phase,  some  of  the  phrase  transformation 
rules,  which  are  called  "semantic  templates",  are  applied  to 
check  the  semantic  compatibility  of  phrase  components  with  one 
another  by  using  the  data  description  as  the  guide. 

In  the  PLANES  system,  the  above  operations  are  further 
divided  into  four  steps:  first,  the  words  of  the  user  query  are 
evaluated  and  substituted  with  the  canonical  words  and  synonyms, 
redundant  words  being  reduced  and  ignored;  second,  the  semantic 
ATNs  (Augumented  Transition  Networks)  are  applied  to  the  input 
request  in  order  to  determine  the  specific  meaning  of  each 
phrase;  third,  concept  case  frames  are  applied  to  the  above 
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phrases  in  order  to  find  the  pattern  of  the  question;  and 
finally,  the  filled-in  concept  case  fr ame  is  translated  into  a 
formal  query  expression  for  use  with  the  relational  data  base 
system  in  the  information  retrieval  phase. 

4.2.2  The  Dialog  Control 

The  Dialog  Control  takes  the  analyzer  output,  tests  its 
logical  completeness,  and  poses  only  those  questions  to  the  user 
that  will  yield  a logically  complete  formal  query.  In  order  to 
produce  a logically  c omp 1 e t e f o r ma 1 query  for  the  info  r ma  t i o n 
retrieval  phase,  the  dialog  control  needs  to  determine  certain 
tactics  to  allow  the  system  to  interact  with  the  user  so  that  the 
ambiguity  involved  in  the  user  query  can  be  clarified. 

4.2.3  The  Synthesizer 

The  Synthesizer  translates  the  logically  complete  formal 
query  output  from  the  Dialog  Control  into  a precise  natural 
language  re-statement.  The  operation  of  the  synthesizer  is  the 
process  of  text  generation  [Barr,  81;  Feigenbaum,  81].  The 
implementation  of  this  process  employs  essentially  the  same 
concepts  and  granxnar  rules  as  the  analyzer. 
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4.2.4  The  Retriever 

This  component  is  invoked  only  when  the  user  has  approved 
the  r e- s t a t ement . After  the  retriever  is  invoked,  it  takes  the 
logically  complete  formal  query  from  the  Dialog  Control  and 
retrieves  data  from  the  data  base  in  order  to  generate  an  answer 
to  that  query.  This  retrieved  answer  is  output  to  the  synthesizer 
which  then  translates  it  into  a precise  natural  language 
statement  to  the  user.  Thus,  the  major  operation  of  the  retriever 
is  data  base  search.  To  process  this  operation,  it  is  necessary 
to  construct  a set  of  search  programs  (generally  written  in  LISP, 
APL  or  Pascal).  By  applying  this  set  of  search  programs,  the 
system  performs  following  operations  sequentially: 

(1)  Selecting  the  relations  or  files  to  be  searched. 

(2)  Selecting  an  order  for  searching  these  files. 

(3)  Generating  an  expression  for  testing  and  selecting 

tuple  values  to  return  while  searching. 

(4)  Generating  a program  to  combine  data,  possibly  from  a 
number  of  different  relations,  so  that  the  proper 
answer  will  be  returned. 

(5)  Deciding  when  to  save  the  results  of  a search  for 
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future  use. 

In  addition  to  the  above  four  major  components,  there  are 
some  equally  important  components  that  need  to  be  implemented  in 
the  develo  pme  nt  of  a natural  language  query  syst  em . Th  e ma i n 
function  of  these  c omp onents  is  to  provide  support  to  the  user, 

analyzer,  dialog  control  and  synthesizer  during  their 

interactions.  These  components  are  briefly  described  as  follows: 

(1)  KNOWLEDGE  BASE:  This  provides  t ime - i ndependen t 

semantic  and  linguistic  information  about  the  data 
base  to  allow  the  system  to  interact  with  reasonable 
intelligence  concerning  any  natural  language  query 

whose  formal  counterpart  lies  within  the  class  of 

formal  queries  supported  as  an  internal  interface 
(e.g.  transformation  rules  for  words  and  phrases). 

(2)  EDITOR:  This  provides  a menu  for  the  user  to  change 
his  query  or  the  system’s  version. 

(3)  HELPER  : This  provides  a menu  for  the  user  to  obtain 
general  information  about  the  kinds  of  data  stored  in 
the  data  base . 

(4)  SUPERVISOR:  This  component  is  responsible  for  invoking 
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each  of  the  c omp  onents  cited  above  wh  e n e v e r 
appropr i at  e . 

The  mos-t  important  function  provided  by  a natural  language 
query  system  is  that  the  system  completely  protects  casual  users 
from  any  data  sublanguage;  on  the  other  hand,  experienced  users 
may  still  use  the  data  sublanguage  defined  by  the  system  to 
process  their  query. 

5 . NATURAJL  LANGUAGE  QUERY  SYSTEM  FOR  M^DAM 

MADAM  is  a bibliographic  information  storage  and  retrieval 
system  developed  within  the  DBMS  Project  of  the  Computer  Science 
Department  at  the  University  of  Southwestern  Louisiana  [Dominick, 
et.  al.,  80].  This  system  includes  three  major  subsystems:  Data 
Base  Search  Subsystem,  Data  Base  Administration  Subsystems,  and 
System  Administration  Subsystem. 

Prior  to  conmuni  ca  t ing  with  the  MADAM  system  for  information 
needs,  users  have  to  learn  to  handle  a set  of  system  conmands  • 
This  requirement  may  keep  casual  users  away  from  using  such  a 
system,  or  limit  their  use  of  the  system.  Thus,  to  serve  this 
user  group,  the  development  of  a natural  language  query  system 
for  MADAM  is  necessary.  In  this  section,  a framework  for  such  a 
subsystem  within  the  MADAM  system  is  proposed  based  on  the 
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discussion  in  the  previous  sections. 

In  the  framework  presented  here,  the  application  of  the 
natural  language  query  sub— system  is  restricted  and  prepared  only 
for  the  Data  Base  Search  Subsystem  of  MADAM.  The  major  reasons 
for  imposing  such  a restriction  are  as  follows: 

(1)  Among  the  three  subsystems  within  MADAM,  the  users  of 
the  Data  Base  Administration  and  System  Administration 
Subsystems  are  typically  information  system  and 
database  professionals.  Those  who  can  use  only  the 
Data  Base  Search  Subsystem  may  be  the  users  who  need  a 
natural  language  query  system. 

(2)  The  currently  developed  natural  language  query 
systems,  such  as  RENDEZVOUS,  PLANES  and  LUNAR,  are 
mainly  concerned  with  fact  retrieval  rather  than 
updating  data  values  or  modifying  data  bases.  The 
major  reason  for  this  development  approach  is  that 
data  base  search  is  the  primary  function  of  any 
information  system  [Wiederhold,  83].  Thus,  it  is 
reasonable  to  develop  a natural  language  query  system 
for  the  Data  Base  Search  Subsystem  at  the  pilot  stage. 
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The  framework  proposed  here  is  organized  into  two  major 
parts.  The  first  part  specifies  four  levels  of  the  information 
retrieval  process  and  describes  required  modifications  to  the 
existing  M\DAM  system;  the  second  part  suggests  a development 
approach  for  the  natural  language  query  system. 

5.1  Four  Levels  of  the  Information  Retrieval  Process 

It  is  helpful  to  describe  how  the  system  understands  a 
user’s  query  in  the  form  of  natural  language,  processes  it, 
produces  correct  answer,  and  generates  response  to  the  user  in 
the  form  of  natural  language.  In  this  framework,  the  above 
process  can  be  divided  into  four  levels  (see  Figure  5-1).  In  the 
discussion  on  this  subject,  the  first  two  levels  are  of  primary 
concern  since  the  introduction  of  these  two  levels  would  provide 
MADAM  wi th  the  capability  to  understand  and  answe r queries  in  the 
form  of  natural  language  in  addition  to  formal  query  language 
comnands  . 
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FIGURE  5“1  Four  Levels  of  the  Information  Retrieval  Process 
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5.1.1  Natural  Language  Level 

This  level  is  the  interface  level  of  the  casual  user— system 
interaction.  At  this  level,  the  user  and  the  system  comnunicate 
with  each  other  in  the  fo rm  of  natural  language  (dialog  and/or 
mu Itiple  — choice  questions) • Each  info r ma tion  retrieval  activity 
is  initiated  when  a user  inputs  his  query  and  is  actually 
terminated  when  the  system’s  response  is  accepted  by  its  user  at 
this  1 eve  1 . 

The  techniques  involved  in  the  design  of  this  level  is  the 
capability  of  the  system  in  translating  natural  language  input 
into  a system  defined  formal  language  and  that  of  the  natural 
language  output  generation.  Each  time  the  system  generates  a 
re-statement  of  the  user’s  query,  it  should  output  the 
r e- s t a t emen t along  with  the  user’s  query  so  that  the  user  may 
c omp  are  his  own  query  with  the  syst  em ’s  perception  of  his  query. 
If  the  system  finds  any  ambiguity  in  the  user’s  query,  it  may 
generate  questions  in  the  fo  rm  of  a mu  Itiple  — choice  questions 
along  with  some  hints  and  the  user’s  source  statement  so  that  the 
user  may  review  his  intention  and  modify  the  query  statement 
using  the  assistance  provided  by  the  system. 
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5.1.2  Natural  Language  Processor 

The  user  query  in  the  natural  language  query  system  is 
non-procedural  and  informal;  on  the  other  hand,  the  comnands  used 
in  the  Data  Base  Search  Subsystem  of  MVDAM  are  non— pr ocedur a 1 , 
but  highly  structured  and  formal.  Thus,  it  is  necessary  to  have 
a natural  language  processor  which  can  perform  the  syntactical 
and  semantic  analysis  on  a natural  language  user  query  and 
generate  a formal  query  acceptable  by  the  existing  system. 

The  design  of  such  a processor,  based  on  the  discussion  in 
the  last  sections  and  especially  Figure  3-1  and  Figure  4-2  should 
include  the  analyzer,  the  dialog  control  and  the  synthesizer,  as 
well  as  other  assistance  components  such  as  the  knowledge  base 
and  helper. 

The  basic  work  of  the  analyzer  is  to  transform  the  natural 
language  query,  syntactically  and  semantically,  into  one  of  three 
types  of  formal  query  expressions  in  the  Data  Base  Search 
Subsystem  by  applying  the  granmar  rules,  relations,  tuples  and 
operators  stored  in  the  knowledge  base.  The  synthesizer  performs 
the  same  function  in  the  reverse  direction. 

In  designing  these  two  components,  as  discussed  in  the 
previous  sections,  the  designer  should,  first,  construct  a set  of 
granmar  rules  based  on  the  relations  in  the  data  base  and  the 
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selection  of  appropriate  techniques  of  natural  language 
understanding,  such  as  transformational  granmars  and  case 
gramnars;  second,  develop  a knowledge  base  of  sufficient  size  and 
capability.  This  knowledge  base,  which  must  be  installed  into  the 
Mi\DAM  system  will  serve  as  the  brain  of  the  Natural  Language 
Processor  in  natural  language  understanding.  Thus,  the  design  of 
such  a knowldege  base  is  not  only  important  but  critical  to  the 
success  of  the  natural  language  query  system. 

Different  from  most  developed  natural  language  query 
systems,  in  which  a relational  calculus  language,  ALPHA,  is 
applied  as  data  sublanguage,  the  formal  query  applied  in  MADAM  is 
a higher-level  language.  Thus,  in  the  design  of  this  phase,  a 
two-step  translation  may  be  required.  In  this  process,  a 
relational  calculus  language  may  be  used  as  an  intermediate 
between  natural  language  query  and  the  data  sublanguage  used  by 
the  MADAM  system. 

The  Dialog  Control  needs  to  check  the  logical  completeness 
of  a user  query  and  pose  questions  to  the  user  in  order  to 
organize  a logically  complete  formal  query.  Thus,  some  semantic 
analysis  techniques  such  as  ATNs  should  be  considered  in  the 
design  of  this  c omp o n e n t . 

The  helper  component  will  be  constructed  by  modifying  the 
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help  commands  in  the  MADAM  Data  Base  Search  Subsystem  so  that  the 
result  of  each  ’’help”  command  can  be  presented  in  a form  of 
precise  natural  language. 

Since  the  Natural  Language  Processor  performs  many  functions 
and  operations,  it  is  necessary  to  have  a driver  which  invokes 
the  appropriate  operation  by  initiating  a specific  subroutine 
mentioned  above  based  on  the  state  of  the  transformation  process. 
Therefore,  it  is  necessary  to  design  a Supervisor  routine  to 
invoke  and  supervise  various  operations. 

5.2  The  Development  Approach  for  the  Natural  Language  Query 
Sy s t em 

It  is  predictable,  in  the  development  of  a natural  language 
query  system  within  MM3AM,  that  many  problems  and  difficulties 
will  be  encountered,  for  example,  how  large  of  the  knowledge  base 
is  required  for  such  a system?  Can  the  system  being  developed 
understand  any  natural  language  query?  How  many  rules  are  needed 
to  be  generated  for  the  syntactic  and  semantic  transformation? 

5.2.1  The  Traditional  Approach  of  Query  System  Design 

Traditionally,  conmercially  available  database  systems 
usually  offerred  comparatively  general-purpose  interfaces  which 
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were  suitable  only  for  ”DB  specialists”.  Under  this  approach,  two 
basic  ass  ump  tions  on  the  users  of  c omp  uterized  info  rma  tion  syst  em 
were  widely  accepted.  The  assumptions  and  their  critiqueing 
ref  er ence  s are : 

(1)  Whenever  a user  conceives  a query,  he  can  convey  his 

intent  to  the  system  faithfully  and  precisely  [Codd, 
74]  . 

(2)  The  user  is  willing  to  develop  the  appropriate  skills 
and  learn  the  ”user-suppor t s ” to  operate  an 
information  system  [Eason,  75]. 


Since  the 
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group 
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above 

ass  ump  tions  are 

obviously  inva lid. 
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researchers  have  found 

that. 
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using 

an 

info  rma  tion  syst  em , the  casual  user  tends  to  expect  a tool  wh i c h 
fits  his  needs  and  does  not  expect  to  modify  his  own  behavior  to 
fit  the  system  needs.  Additionally,  the  requirement  of  learning 
formal  query  languages  usually  causes  one  of  three  responses: 

(1)  Non-use  of  the  system. 

(2)  Limited  use  of  the  system. 
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(3)  The  use  of  a human  intermediary. 

Therefore,  in  order  to  develop  a natural  language  query 
system  which  can  provide  an  effective  casual  user-system 
interface,  traditional  thinking  concerning  the  nature  of  users 
mu  St  be  adjusted. 

5.2.2  Experimental  Approach 

To  adjust  the  traditional  approach  of  query  system 
development,  this  project  proposes  an  experimental  approach.  The 
fundamental  assumption  of  this  approach  is  that,  in  an 
information  system  providing  a natural  language  interface,  the 
system  has  to  "think**  and  **speak**  as  its  user,  a human  being. 
Based  on  this  assumption,  the  designer  has  to  understand  the 
mainstream  concepts  of  behavioral  science,  such  as  learning 
psychology  and  human  conmuni  ca  t i on  theories,  as  well  as  of 
natural  language  understanding  and  knowledge  representation  in 
the  AI  field. 

Based  on  the  concepts  of  behavioral  sciences,  it  is 
reasonable  to  understand  that  it  is  impossible,  at  the  early 
stage  of  development,  to  have  a system  whose  **  expe  r i enc  e **  and 
**intel  1 igence**  allows  it  to  understand  all  the  queries  or  issues 
of  human  conversation,  and  to  use  natural  language  fluently.  On 
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the  contrary,  a natural  language  query  system  should  have  a 
limited  capability  of  both  natural  language  underst and i ng  and 
natural  language  generation,  and  this  capability  should  grow 
gradually  by  the  increase  of  its  ”e xpe r i e nc e ” and  "vocabu 1 ary” . 

The  experimental  approach  proposed  in  this  project  is  based 
on  the  above  consideration.  The  de ve 1 opmen t of  a natural  language 
query  system  should  be  accomplished  by  consecutive  experiments. 
In  each  experiment,  the  designer  should  restrict  the  scope  of 
queries  in  limited  topics  and  obtain  certain  distinct  natural 
language  requests  in  these  topic  areas  through  interviewing 
” s amp  led”  casual  users;  then,  develop  a subset  of  a natural 
language  query  system  which  has  the  ability  to  ”understand”  these 
queries  and  ”respond”  to  these  queries.  The  developed  system, 
then,  should  be  integrated  with  previous  developed  subsets  of  the 
system.  In  such  a way,  the  knowledge  base  of  the  system  can  be 
expanded  as  well  as  the  system’s  ability  to  understand  and  use 
the  natural  language. 
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6.  CONCLUSION 

Computerized  information  systems  are  created  for  the  benefit 
of  the  end  users.  According  to  Codd’s  estimate  [Codd,  71],  ”by 
the  mid  1990s,  the  home/casual  user  of  such  systems  will  be  the 
dominant  factor  in  the  total  utilization  of  database  resources”. 
If  computerized  information  systems  are  to  become  everyday  tools 
of  casual  users,  the  needs  and  desires  of  the  casual  users  must 
be  acconmodated . Therefore,  the  development  of  natural  language 
query  systems  must  become  a major  trend  in  information  system 
de ve 1 opment . 
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AN  OVERVIEW  OF  THE 
USL  / DBMS  NASA  / PC  R&D  PROJECT 
\\DRKING  PAPER  SERIES 


ABSTRACT 


The  USL/DEMS  NASA/PC  R&D  Working  Paper  Series  has  been 
established  to  provide  a mechanism  for  dociunenting  the  activities 
that  are  being  performed  by  the  University  of  Southwestern 
Louisiana  pursuant  to  the  specifications  of  National  Aeronautics 
and  Space  Administration  Contract  Niunber  NASW-3846. 

The  USL/DEMS  NASA/PC  R&D  Project  is  addressing  a wide 
variety  of  PC-based  research  and  development  areas  oriented 
toward  the  effective  utilization  of  microcomputers  in  support  of 
casual  user  access  to  remote,  mainframe-based,  large-scale 
interactive  information  storage  and  retrieval  systems. 

This  document  represents  an  index  into  the  entire  USL/DEMS 
NASA/PC  R&D  Working  Paper  Series. 


I DEMS  .NASA/PC  R&D-l  I 


2 


I WJRKING  PAPER  SERIES  I 


I NASA  I 


I N A S A I 


USL/DHvIS  NASA/ PC  R&D  W3RKING  PAPER  SERIES  INDEX 


Following  is  a table  of  contents  of  the  USL/DBMS  NASA/PC  R&D 


Working  Paper  Series.  Dociunents  that  are  completed  and  are 
available  for  dissemination  are  listed  in  the  first  part  of  the 
table  of  contents.  The  second  part  of  the  table  of  contents 


represents  an  identification  of  the  doc ume nts  that  are  currently 
in  progress.  As  these  are  completed,  they  will  be  incorporated 
into  the  Working  Paper  Series  and  hence  will  be  available  for 


di s seminat i on . 
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THE  USL  NASA  PC  R&D  PROJECT: 
GENERAL  SPECIFICATIONS  OF  OBJECTIVES 


\ 

ABSTRACT 


This  document  represents  a general  and  high-level 
identification  of  the  initial  set  of  objectives  to  be  addressed 
within  the  scope  of  the  USL  NASA  PC  R&D  Project. 

Detailed  specifications  of  objectives,  tasking  assignments, 
schedules,  and  implementation  plans  for  each  of  the  general 
objectives  identified  within  this  document  will  be  addressed 
within  future  entries  within  this  PC  R&D  Working  Paper  Series. 
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THE  USL  NASA  PC  R&D  PROJECT: 
GENERAL  SPECIFICATIONS  OF  OBJECTIVES 


(1)  PC  FUTURE  FACILITIES  PLANNING 

(a)  Hardware  acquisition  r e comnenda t i ons . 

(b)  Software  acquisition  recommendations. 

(c)  Preparation  of  Purchase  Requisitions  after  approval  of 
acquisition  r e c omnenda t i ons . 

(d)  Conduct  of  facilities  planning  process  in  light  of 
currently  severe  budgetary  constraints. 

(2)  PC  USAGE  ENVIRONMENT  PREPARATION 

(a)  Preparation  of  specifications  for  PC  access  control 
policies,  i.e.,  policies  controlling  who  is  allowed 
usage  access  of  the  PC,  what  they  are  allowed  to  do, 
etc. 

(b)  Preparation  of  specifications  for  PC  usage  training, 
i.e.,  development  of  training  programs  to  be  followed 
by  individuals  prior  to  PC  usage,  potentially  including 
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training  seminars,  interactive  demos,  manuals  or 
portions  thereof  to  be  reviewed,  etc. 

(c)  Preparation  of  system  development  standards  for  systems 
design,  programning,  testing,  and  documentation  for  use 
within  a C programning  environment  on  the  PC’s. 

(d)  Preparation  of  specifications  for  backup/recovery 
procedure  s . 

(3)  PC  R&D  PLANNING:  SPECI FICATIONS  OF  R&D  OBJECTIVES 

(a)  PC-bas.ed  information  system  simulators  and  data  base 
s imu  1 a tor  s . 

(b)  PC-based  user/ system  interfaces  to  remote  information 
sy s t ems  . 

(c)  Definition  of  multi-system  conmon  comnand  language  and 
PC-based  front-end  comnon  comnand  language  translators. 

(d)  PC-based  CAI  training  mechanisms  for  remote  information 
s y s t ems . 
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(e)  PC-based  scientist's/engineer’s  R&D  workstation: 

(el)  Standalone  workstation  functionality. 

(e2)  Distributed/networked  workstation  f unc t i ona i 1 ty . 

(e3)  Distributed  / networked  workstation 

interconmunicat ion  and  uploading/downloading 
protocols  (between  workstations;  between 

workstation  and  remote  mainframes). 

(f)  PC-rbased  graphics. 

(g)  Loaner  IBM  PC  XT/370:  what  would  we  do  with  it?  why 
would  we  do  this?  how  would  we  like  it  configured? 
when  do  we  need  it?  for  how  long? 

(h)  PC-based  workbench  to  support  the  current  NASA  contract 
work  environment,  including  what  workbench  facilities 
should  be  implemented  at  the  PC  level,  what  workbench 
facilities  should  remain  at  the  Multics  level,  and  how 
the  PC  workbench  should  comnunicate  with  the  Multics 
workbench . 

(i)  PC-based  support  for  knowledge-based  systems. 

(j)  PC-based  support  for  information  system  performance 
measurement  and  evaluation. 
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(4)  PC  R&D  PLANNING:  IMPLEMENTATION  OF  R&D  OBJECTIVES 

Preparation  of  an  implementation  plan  for  each  item  listed 
in  section  (3)  above.  For  internal  projects,  e.g.,  the  PC 
workbench,  the  implementation  plan  should  presume  existing 
staffing,  no  extra  budget,  etc.  For  external  projects, 
i.e.,  any  project  that  may  be  of  interest  to  an  external 
funding  agency,  the  implementation  plan  should  have  as  its 
deliverable  a contract  proposal  (e.g.,  PC  simulator 
proposal,  IBM  equipment  acquisition  proposal,  etc.).  In 
either  case,  the  implementation  plan  should  specify  tasking 
assigiunents  (who  will  be  responsible  for  what  parts  of  the 
implementation)  and  a schedule  (milestone  date  for  each  part 
of  the  implementation). 
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The  USL/DBMS  NASA/PC  R&D  Working  Paper  Series  contains  a 
collection  of  formal  and  informal  reports  representing  results  of 
^C“based  research  and  development  activities  being  conducted  by 
the  Computer  Science  Department  of  the  University  of  Southwestern 
Louisiana  pursuant  to  the  specifications  of  National  Aeronautics 
and  Space  Administration  Contract  Number  NASW-3846. 


For  more  information,  contact: 


Wayne  D.  Dominick 
Ed i t or 
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P.  O.  Box  44330 
Lafayette,  Louisiana  70504 
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The  USL  NASA  PC  R&D 
DEVELOPMENT  ENVIRONV1ENT  STANDARDS 


ABSTRACT 


To  facilitate  the  develo pme n t of  PC  based  projects,  it  is 
necessary  to  establish  a set  of  operating  standards.  The  intent 
of  these  procedures  is  to  prevent  unintentional  interference 
between  projects  being  concurrently  developed  on*the  PCs. 


The  standards  address  the  following  areas  : 

Scheduling  PC  resources 
Login/Logout  Procedures 
Tra ining 

File  Naming  Conventions 
Hard  Disk  Organization 
Diskette  Care 
Backup  Procedures 
Copying  Policy 


Progranming  standards  will  be  addressed  in  separate  ’PC 
Programning  Standards’  documents. 
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I . SCHEDULIMj  pc  resources 

In  order  to  assure  a rational  allocation  of  PC  resources,  a 
project  proposal  must  be  submitted  to,  evaluated  by,  and 
scheduled  by  the  PC— R&D  Team  before  any  pc— based  development  work 
is  initiated.  The  proposal  should  contain  an  estimate  of  PC  time, 
PC  storage,  and  system  software  required.  The  evaluation  process 
will  assign  a priority  to  the  project  and  schedule  (or  not 
schedule)  it  accordingly.  A schedule  sheet  will  be  posted, 
containing  the  current  PC  time  reservations.  Any  unreserved  time 
slots  can  be  used  for  training  and  experimentation. 

II.  LOGIN/LOGOUT 

On ce  a project  is  scheduled  , all  develo pme nt  should  be  done 
while  logged  in  under  that  project.  The  login/logout  procedures 
are  intended  only  to  allow  some  measurement  of  PC  resource 
utilization.  Each  scheduled  project  will  be  assigned  a project 
name  to  be  used  for  relevant  development;  work  not  pertinent  to 
a scheduled  project  should  be  performed  under  the  train  project. 
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III.  TRAINING 

Training  materials  will  be  made  available  for  all  system 
software  in  terms  of  users  manuals,  conmented  working  examples, 
online  help,  and,  in  some  cases,  online  tutorials.  As  training 
material  becomes  available,  notices  will  be  distributed  via 
Multics  mail  and  through  demonstration  sessions.  Questions 
may  be  placed  in  the  PC  Black  Box;  questions  and  answers  will  be 
posted. 

IV.  NAMING  CONVENTIONS 

PC  DOS  2.1  allows  eight  character  file  names  with  three 
letter  extensions.  To  allow  consistent  and  efficient  use  of  wild 
card  file  specifications,  the  following  naming  conventions  should 
be  adhe red  to: 

1)  The  first  eight  characters  positions  should  contain  only 
the  characters:  { * a * . . ’ z ’ , *A* . . »Z*  , ’ 1 • . . ’ 9 * , } and  should 
comprise  a meaningful  name. 


2)  Extensions  should  indicate  file  type  or  format 

recomnend  extensions  are: 

HLP  - He  Ip  files 

SYS  -*  System  log  files 

PAS  - PASCAL  source  files 

BAS  - BASIC  source  files  (compressed  and  ascii) 

C - C source  files 

” Files  in  the  Multics  runoff  format 


The 
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WX  - Files  in  the  Wo r d i x f o rma t 

RO  - Runoff  output 
V*D  - Wo rdix  output 

OBJ  - Unlinked  intermediate  object  code 

EXE  - Executable  machine  code 

CCM  - Executable  machine  code  (quick  load  format) 
BAT  - ASCII  files  containing  DOS  commands 

ASM  - Assembler  source  code 

LIB  - Library  files  (contain  multiple  OBJs) 

DVC  - Printer  device  drivers 


V.  HARD  DISK  ORGANIZATION 

PC  DOS  2.1  supports  a hierarchical  file  system  which  is  a 
valuable  storage  management  feature.  The  following  structure 
policy  has  been  adopted: 


1)  The  ROOT  directory  (\)  will  contain  only  other  directory 
entries  and  system  startup  batch  files. 

2)  Each  registered  user  will  have  an  individual  directory 
under  work  not  appropriate  to  project  d i r e c t or i e s .&D  for 

3)  The  0^M  directory  will  be  used  for  uploading  and 
downloading  files.  Once  the  accuracy  of  the  file  is 
established,  it  should  be  inxnediately  copied  out  of  the 
directory  to  the  appropriate  area  and  deleted. 

4)  Because  access  to  overlays,  libraries,  and  error  files  is 
necessary  for  most  compilers,  all  compilations  should  be 
done  in  the  appropriate  language  files  removed,  before  users 
logoff. 
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5)  For  each  project,  an  operational  and  a develo pme n t a 1 
directory  will  be  established.  Code  will  be  migrated  from 
the  develo  pme  ntal  to  the  operational  directory  only  after  it 
has  met  pre-defined  debugging  criteria  (see  C Programning 
Standards ) 

6) The  \DOS  directory  contains  system  support  files.  No  files 
should  be  added  to  this  directory. 

7)  All  major  software  systems  will  be  located  in  dedicated 
directories  to  facilitate  installation  and  backup.  (e.g., 
\DBASE2,  CMvl,  \WP\EDIX,  etc.) 

VI.  DISKETTE  CAKE 

Floppy  diskettes,  because  they  are  exposed  directly  to 
environmental  conditions,  require  a certain  degree  of  care  to 
ma ntain  their  integrity.  Th e foil ow ing  guidelines  should  prevent 
any  difficulties: 

1)  Keep  diskettes  in  jackets  until  they  are  inserted  into 
the  di sk  dr i ve . 

2)  If  diskettes  mu st  be  carried  out  of  the  lab,  keep  th em  i n 
a rigid  sealed  container.  Keep  diskettes  away  from  heat  and 
mo  i s t u r e . 

3)  Never  bend  diskettes  or  touch  the  mylar  surface.  Should  a 
diskette  become  contaminated,  do  not  insert  it  into  the 
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diskette  drive.  To  do  so  would  cause  contamination  of  disk 
dr ive  heads  . 

4)  Never  write  on  diskettes  with  a ballpoint  pen;  use  felt 
tip  ma rkers  only. 

5)  Always  label  diskettes,  regarding  contents  and  write 
protect  critical  diskettes  by  covering  the  write  protect 
notch  with  a write  protect  tab. 

VI 1 . BACKUP  PROCEDURES 

Project  directories  will  be  backed  up,  via  the  backup 
comnand,  by  system  personnel  at  5pm  on  Fridays.  Users  will  be 
responsible  for  backing  up  any  significant  changes  in  the 
interim.  All  backup  diskettes  should  be  clearly  labeled,  showing 
date  of  backup,  directory  path,  contents,  and  sequence  number, 
for  mu  1 1 i -d i ske 1 1 e backups. 

VIII.  COPYING  POLICY 

Purchased  software  may  be  copied,  for  backup  purposes, 
exclusively  by  system  personnel.  Users  may  not,  for  any  reason, 
copy  software  purchased  for  use  on  the  PC/XT s . Illegal 
distribution  of  software  jeopardizes  not  only  the  individuals 
involved,  but  the  University  and  the  project  as  a whole. 
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GENERAL  SPACI FICATIONS 
FOR  THE  DEVELOPMENT  OF 

A PC-BASED  SIMULATOR  OF  THE  NASA  RECON  SYSTEM 


ABSTRACT 


This  document  will  describe  the  general  specifications  for  a 
NASA/ RECON  simulator  targeted  for  a Personal  Computer. 
Information  system  simulation  provides  several  advantages  during 
system  training,  since  it  allows  extensive  use  of  the  system 
without  the  typically  high  cost  overhead  of  accessing 
large-scale,  remote  systems  and  also  can  provide  a better  user 
interface  and  assistance.  This  means  less  cost  for  the  end-user, 
faster  and  more  efficient  training,  all  resulting  in  increased 
user  productivity. 
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GENERAL  SPECIFICATIONS  . 

FOR  THE  DEVELOPMEOT  OF 

A PC-BASED  SIMULATOR  FOR  THE  NASA  RECON  SYSTBVI 

This  is  a working  document.  If  you  have  any 
conments  please  contact  the  PC  Simulator  R&D  team. 
Versions  of  this  document  will  be  circulated  on  a 
regular  basis  until  finalization.  The  design  and 
implementation  of  the  simulator  will  require  many 
changes  suggested  by  individual  reviewers;  your 
feedback  will  be  appreciated. 

I . INTRODUCTION 

This  document  will  define  the  specifications  for  the  IBM 
PC/XT-based  NASA/RECON  System  Simulator.  Input  to  this  document 
has  been  from  the  USL  NASA  Contract  Team  and,  up  to  this  point, 
not  from  the  NASA/RECON  designers. 

An  information  system  simulator  is  defined  as  a program  that 
behaves  like  a certain  information  system.  The  purpose  of  such  a 
simulation  is  multiple:  prototyping,  CAI  , reducing  online  costs, 
etc.  In  the  NASA/RECON  simulator,  the  main  motive  has  been  the 
development  of  a simulator  as  an  educational  tool  to  allow 
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instruction  without  paying  the  high  ($50. 00/hour  or  more)  cost  of 
long  distance  telephone  charges,  TELENET  charges,  and  online  host 
system  charges.  Also,  CAI  could  be  embedded  in  the  implementation 
so  that  teaching  a potential  user  can  be  highly  automated  and  thus 
s imp  1 i f i ed . 

In  simulating  an  information  system  as  large  and  as  powerful  as 
the  NASA/RECX)N  system,  it  should  be  of  top  priority  to  decide  very 
early  on  the  features  that  should  be  included  as  well  as  the 
features  to  be  excluded,  if  any.  The  original  NASA/RECON  system 
is  written  in  PL/IG  and  runs  on  an  IBM  4341  computer  (NASA/RECX)N 
Users  Manual).  Trying  to  simulate  it  on  an  IBM  PC/XT  would  need 
very  careful  planning  concerning  what  is  to  be  included  and  what 
is  to  be  exc 1 uded . 

In  such  cases,  where  a program  has  to  be  migrated  or  simulated 
from  one  computer  to  another,  it  is  obvious  that  the  techniques 
applied  in  the  original  implementation  may  not  be  applicable  to 
implement  the  model.  In  the  following  pages,  some  details  will  be 
highl ighted. 
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II.  GENERAL  FILE  DESIGN 


The  NASA/RECX)N  system  is  a bibliographical  Information 
Storage  and  Retrieval  System.  The  system  is  based  on  a thesaurus, 
a list  of  words  and  related  terms  on  which  searches  can  be  made. 
Th  e thesaurus  is  the  ma  in  part  as  it  provides  a basis  for 
subsequent  indexing  of  entries  according  to  standard  conventions 
and  terms.  In  reality,  the  NASA/RECX)N  thesaurus  contains  several 
thousand  entries  and  approximately  2 million  records  in  all  file 


collections . 

It  is 

obvious  that 

the 

PC-based 

s imu  lator  can 

not 

contain  mo  r e 

than 

a fraction 

0 f 

these  records 

. Still, 

the 

the  s au  r u s is 

needed 

as  it  is  the 

ma  i n 

facility 

for 

indexing 

and 

re^trieving  documents  and  the  PC-based  thesaurus  should  be  of  a 
reasonable  size  to  support  simulating,  if  not  replicating  reality. 


Record  de 

sign  should  follow  the 

NASA/RECON  standard,  with 

fields 

for  the  following  items  (as  a 

minimum/f i r s t requirement  ) : 

ACC: 

accession  number 

FST: 

financial  support  type 

ISS: 

issue  n umb  e r 

JAP: 

page  numbers 

CAT: 

subject  category 

Note:  in  all  entries. 

RN: 

report  number 

*****  denotes  a 

CN: 

contract  number 

directly  searchable 

< 

PDI  : 

publication  date 

t e rm  whi  ch  is 

PAG: 

number  of  pages 

indexed  (keyed) . 

LNG: 

document  language 

UTI  : 

unc lassified  title 

TLS: 

title  supplement 

> 

AU: 

personal  author 

PAA: 

personal  author  affiliate 

CO: 

corporate  source 

PUB: 

pub  1 i she  r 
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In  addition,  the  following  items  must  be  included  for  text 
searches  in  the  data  base: 

* MJS:  major  terms 

* Iv^4R : minor  terms  both  form  ST  (subject  terms) 

ABS : abs  t rac  t 

SLM:  sunmary 

* AN I : analytical  te  rms 

* ANN:  analytical  notes 

Other  terms  and  fields  can  be  added  as  needed,  if 

implementation  constraints  allow  such  expansions.  However,  file 
design  depends  on  the  file  management  system  to  be  used. 

File  structures  like  the  above  wo uld  need  disk  space  on  the 
order  of  1300-1500  characters  per  record  so  that  all  items  are 
searchable,  excluding  keys.  The  file  system  to  be  acquired  will 
support  the  Indexed  Sequential  Access  Method  (ISAM),  based  on 

multiple  user-defined  keys.  Thus,  an  inverted  file  structure  will 
be  used,  with  all  searchable  items  keyed,  together  with  a record 
n umb er  to  identify  the  entire  record.  If  the  n uxhb er  of  records  is 

kept  small,  then  we  can  use  sequential  searches  as  well  to  avoid 

multiple  indices  and  the  associated  space  requirements  as  well. 

On  double  sided,  double  density  diskettes,  up  to  150  records 
can  be  included.  A second  diskette  will  contain  the  program,  ISAM 
file  management,  user  stored  queries,  scratch  files  and  other 
supporting  software.  The  thesaurus  and  d i c t i onary/ suppo r t files 
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will  be  included  in  the  data  disk.  Thus,  a two-disk  based 
approach  is  neccesary  if  simulation  is  to  be  realistic.  Program 
size  should  be  around  128  to  256  Kbytes,  possibly,  by  chaining  some 
parts  of  the  program  on  and  off  the  program  disk.  Program  data 
size  has  to  be  limited  if  effective  use  of  the  system  and 
compatabi 1 i ty  with  others  are  desired. 


An  estimation  of  the  disk  space  requirements  (tentative)  is 
as  foil  ows  : 


240K:  data  base 
45K  : index  lists 

4 OK  : Thesaurus 
16K  : Linking 
24K  : Free 


(150  records  x 1600  by t e s / r e c o r d ) 

(150  records  x 15  items  x 20  bytes/item) 
((20  bytes/term  20  ptrs)  x 1000  terms) 
(see  next  page) 

(workspace , e tc . ) 


365K:  Total  disk  space,  doub 1 e- s i ded , double-density 

A brief  explanation  on  the  storage  allocation  estimates 
foil ows  : 

a.  Data  Base:  The  average  NASA/RECX)N  record  fits  in 

approximately  one  screen  of  a Cathod-Ray  Terminal,  which  is 
24  X 80.  By  limiting  line  length  to  approximately  60,  as 
RECON  does,  we  arrive  at  a length  of  1600  byte  s/record 
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approximately  as  an  average. 

b.  Index  lists:  Assuming  an  indexed  sequential  file,  then  with 
15  searchable  indexed  terms,  allocating  20  bytes/record  (this 
would  be  17—18  for  the  term  and  1—2  for  the  record  number) 
makes  a total  of  45K.  This  depends  on  the  characteristics  of 
the  ISAM  file  management  package  to  be  used;  however,  other 
similar  packages  have  approximately  the  same  space 
requi rement  s . 

c.  Thesaurus:  Assuming  a maximum  number  of  1000  entries, 

including  20  pointers  (max)  for  each  term,  4 each  to 

narrower,  broader,  related  and  used  for,  and  20  more  bytes 

« 

for  the  term  and  the  associated  record  number,  we  need  40 
bytes/record  for  a total  of  40K  bytes. 

d.  Linking  list:  Used  for  the  thesaurus,  it  is  an  inverted  list 
of  thesaurus  terms  and  record  numbers,  indexed  on  record 
numbers.  This  facilitates  thesaurus  cross-references  and 
minimizes  disk  references.  The  space  needed  is  20 
bytes/record  for  1000  records  giving  a total  of  20K  bytes. 

e.  Free:  This  area  can  be  used  for  any  purpose  that  might  arise, 
but  as  read-only.  Temporary  areas  will  reside  on  the  program 
disk.  This  area  will  also  cover  unexpected  changes  in  the 
design  or  other  changes  dictated  by  the  de s i gn/ imp  1 ement a t i on 
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eye  1 e . 

Th e design  of  the  data  file  struetures  wa s ma inly  influeneed 
by  the  need  for  fast  aceess  to  data.  Regular  inverted  file 
strueture  is  not  adequate  in  the  ease  that  the  entire  reeord  needs 
to  be  displayed.  Thus,  in  order  to  inerease  speed  of  aeeess,  the 
lists  and  the  reeords  themselves  earry  the  information 
redundandt ly . 

As  it  stands,  the  original  design  does  not  inelude  any 
Computer  Aided  Instruetion  improvements,  with  the  exeeption  of 
more  specific  error  messages.  If  CAI  is  to  be  incorporated,  then 
one  more  disk  would  be  required  for  the  CAI  material. 
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III.  NASA/ RECON  COvMAND  LANGUAGE 

The  NASA/RECON  system  features  a quite  simple  instruction 
format.  Abbreviations  for  the  conmands  can  be  used.  All 
parameters  follow  the  command  after  either  a space  or  a slash 
(”/*•).  Some  conmands,  while  they  are  functional  on  NASA/RECON, 
will  be  reproduced  in  the  simulator  just  for  "simulation'*  purposes 
without  doing  anything  functional.  Others  will  perform  tasks 
parallel  to  the  corresponding  mainframe  NASA/RECON. 

A list  of  ^ no-operation  conmands  and  their  corresponding 
actions  foil  ows  : 

BEGIN  starts  a search  session;  the  user  is  asked  to  select  a file 
collection  and  is  placed  in  the  RECON  search  environment. 
Then  the  RECON  message  is  printed  and  the  user  conmences  the 
search.  BEGIN  can  also  function  as  a restart  function  to 
allow  clean-up  of  previous  searches  and  terminate  current 
session,  although  END  SEARCH  should  be  used  instead. 

CANCEL  will  print  a message  but  will  not  cancel  a queued— up  query, 
since  there  is  only  one  user. 

CX^^MAND  STATUS  will  also  function  like  CANCEL  since  no  queing-up 
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of  queries  is  permitted. 

END  SEARCH  wi 1 1 terminate  the  current  search  session  and  display 
data  relevant  to  the  search,  and  ask  the  user  some 
info  rma  t i on . 

END  SEARCH  BYPASS  will  terminate  the  session  like  END  SEARCH  but 
will  not  present  the  questionnaire. 

HELP  will  provide  some  help  to  the  user.  The  original  NASA/RECON 
text  can  be  used,  or  more  explanatory  text. 

NEWS  will  display  a login-like  message,  similar  to  RECON’ s . 

ORDER  will  display  a message  similar  to  the  one  displayed  when  a 
document  is  ordered. 

PAGE  can  count  the  number  of  lines  and  stop  every  23  or  so,  and 
wait  for  response.  It  can  be  difficult  to  implement  without 
the  extra  overhead. 

PRINT  will  function  like  the  ORDER,  informing  the  user  of  his/her 
conmand.  Again,  output  should  be  similar  to  NASA/RECON 
output . 

SIGNOFF  will  terminate  the  session  inxned i a t e ly , and  return  the 
user  to  operating  system  level  in  contrast  with  END  SEARCH 
and  END  SEARCH  BYPASS  which  leave  the  user  in  the  simulator. 
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SIGNON  will  be  used  to  start  a user  session  and  allow  the  user  to 
enter  into  the  RECON  system  simulator.  The  user  has  to  enter 
USERID. 

CURRENT  will  print  all  information  about  a user  session,  and  let 
the  user  continue  his/her  session. 

BEGIN  BYPASS  will  start  a search  session  without  asking  for  user 
data. 


NASA/ RECON  functional  coitmands  that  are  executed  and  interact 
with  the  database  are  as  follows: 

EXPAND  will  expand  a term  from  the  system  dictionary.  In 
practice,  the  word  will  be  looked  up  and  all  terms  that  have 


s imi  1 ar  spe  1 1 

ings  are 

printed 

a 1 ong 

with  the  numbers 

of 

occurrence  s , 

like 

the  real 

RECON 

system.  This 

can 

be 

performed  by 

storing 

wo  r d s ( t e 

rms ) and 

occurrences 

in 

the 

same  file,  indexed  by  term  in  ascending  order. 

SELECT  will  select  a set  displayed  by  the  EXPAND  instruction. 
Linked  lists  can  be  used  with  a storage  pool  where  the  sets 
are  represented  by  numbers  (keys).  When  a set  is  to  be 
displayed  or_  otherwise  manipulated,  the  linked  list  will 
recall  the  numbers  (keys)  and  the  ISAM  will  read  in  the 
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appropriate  sets.  Fields  will  be  user  specified. 

The  SELECT  comnand  has  various  forms: 

TEIXT  search  can  be  performed  on  user-specified  words  and 
phrases.  Sequential  searches  will  be  performed  unless 
the  terms  requested  are  indexed.  Sequential  searches 
will  be  performed  in  the  case  of  abstracts,  to  avoid 
excessive  storage  for  files. 

RANGE  search  can  be  performed  by  using  upper  and  lower  values 
in  the  indexes  that  the  terms  are  sorted  upon.  This  can 
be  performed  by  reading  directly  the  lower  bound  and 
from  then  sequentially  until,  the  ux>per  bound. 
Open-ended  searches  can  also  be  supported  in  a similar 
manner . 

ROOT  search  will  have  to  be  performed  sequentially  from  the 
firstrecord  in  the  range  until  the  last  one  in  the 
range.  It  does  not  seem  to  present  major  difficulties. 

COMBINE  will  do  the  basic  Boolean  manipulation  functions  (AND,  OR, 
NOT)  plus  combinations.  For  the  simulator,  a set  expression 
interpreter  will  be  required  to  perform  these  three 
operations  on  sets:  AND  is  Intersection,  OR  is  Union,  M)T  is 
set  diffe r ence . 
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DISPLAY  will  display  user-selected  sets.  The  only  complexity 
involved  is  user-defined  formats.  The  standard  specified 
formats  can  be  used,  allowing  limited  user— defined  formats 
f r om  a pre-defined  subset. 

FREQUENCY  will  definetely  be  complex  enough  to  be  placed  in  a 
deferred  priority  list.  It  can  be  implemented  by  keeping 
track  of  all  M\J  and  MIN  terms,  sorting  the  resulting  list 
for  a given  set  and  producing  frequencies  of  the  resulting 
array  (or  file).  The  problem  will  be  the  time  required  to 
execute  this  instruction. 

KEEP  will  just  make  a copy  of  the  set  requested,  in  the  temporary 
set  99.  It  does  not  seem  difficult,  but  depends  on  the 
complexity  of  the  list  manager. 

LIMIT  will  remove  items  from  the  user  specified  set  based  on  user 
specifications.  It  involves  little  more  than  set  item 
deletion.  LIMIT  ALL  will  do  this  for  all  sets  in  the  current 
process.  LIMIT  RELEASE  will  restore  the  sets  into  their 
previous  state.  File  dumping  every  time  a LIMIT  is  issued 
seems  to  be  a reasonable  implementation  method.  When  a LIMIT 
RELEASE  is  issued,  sets  are  reloaded  from  the  user  file(s)  in 
the  original  condition.  Space  considerations  should  be 
addresed  since  keeping  lists  in  file(s)  would  take  up  fair 
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amounts  of  storage. 

SORT  will  sort  a given  set  based  on  a user-defined  key.  The  time 
required  for  execution  can  be  a problem  but  otherwise  it  can 
be  implemented  with  no  major  difficulties.  Sort  can  be 
performed  on  certain  keys  only,  in  which  case  the  program  can 
be  qu i t e s impl e . 

SEARCH  will  combine  selection  expressions.  A reasonable  way  of 
implementing  it  would  be  to  pass  the  appropriate  arguments  to 
the  EXPAND,  SELECT  and  CCIvIBINE  routines  (provided  that  they 
are  set  up  for  such  tasks)  and  then  finally  come  up  with  one 
set.  Again  time  required  for  execution  will  be  the  only  major 
problem  to  be  identified.  A minor  detail  would  be 
NASA/RECON’s  special  requirements  for  blanks,  stars  (”*”)  and 
quotes,  since  the  allowable  characters  are  not  coitmon  among 
terms  searched. 

SPECIFY  FORMAT  willallow  the  user  to  change  the  default  format(s) 
used.  It  will  relate  to  the  DISPLAY  and  TYPE  conxnands,  since 
it  will  redefine  output  formats.  Away  of  choosing  different 
formats  can  be  found  easily  since  ”C”  allows  formats  to  be 
formed  at  run  time,  and  control  characters  (new— lines, 
line-feeds,  and  various  format  specifications).  This  can  be 
quite  complex,  however  if  many  items  must  be  displayed.  RECON 
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provides  some  standard  formats  (like  /4,  /2,  etc)  that  can  be 
used  to  start  with  and  then  allow  user-defined  formats  later 
on . 

TYPE  will  display  on  the  screen  just  a certain  subset  of  the 
entire  record  for  the  set  specified.  TYPE  can  be  handled  if 
the  SPECIFY  FORMAT  provides  for  the  formats  allowed  (in 
Tit'PE).  Thus,  a call  to  TYPE  can  be  made  as  a call  to  SPECIFY 
FORMAT  to  set  the  format,  a call  to  DISPLAY  and  a call  to 
SPECIFY  FORMAT  again  to  restore  the  original  format. 

RELEASE  will  re-initiate  the  set  node  pool  and  will  also  erase  any 
file(s)  created  by  LIMIT  commands.  It  should  be  used  with  all 
the  search  initiation  and  termination  procedures  and  conmands 
to  ensure  proper  initialization. 
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IV.  PROGRAM  DESIGN  ISSUES 

The  language  that  will  be  used  for  the  implementation  of  the 
NASA/RECON  simulator  on  the  lEM  PC/XT  will  be  ”C” . In  addition,  an 
Indexed  Sequential  Access  Method  (ISAM)  file  management  system 
will  have  to  be  obtained,  since  ”C”  does  not  provide  for  such 
support  . 

The  file  management  system  will  be  used  for  the  support  of 
all  the  inverted  files  to  be  mantained.  Since  all  non-f r ee-t ext 
searchable  terms  will  be  stored  in  inverted  files,  file  design 
should  be  very  carefull  to  avoid  disk  space  overflow.  The  file 
management  system  comes  in  source  code  and  the  rights  (licence) 
for  the  incorporation  of  it  in  user  software.  So  the  file 
management  object  code  should  also  go  on  the  simulator  diskette. 

System  portability  will  have  to  be  considered  not  only  at  the 
PC  level  but  at  the  mini  and  mainframe  level  as  well.  The  ”C” 
compiler  to  be  used  is  compatible  with  Unix  (R)  version  7 ”C” . 
Tests  are  being  performed  to  determine  the  compatabi 1 i ty  between 
the  PC/XT  ”C”  and  the  ”C”  available  on  the  VAX/VMS  system.  The 
primary  goal  is,  of  course,  the  PC/XT  simulator,  but  the 
popularity  of  both  Unix  (R)  and  VAX/VMS  can  be  a major  factor  if  a 
production  version  of  the  simulator  is  made. 
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Stored  queries  will  be  a special  issue  to  be  considered.  Most 
of  the  programs  that  are  needed  to  support  a stored  query  system 
are  the  same  as  the  ones  needed  for  the  interactive  interface.  The 
query  editor  is  not  c omp  licated  and  can  be  easily  i mp  1 erne  n t e d . 

Stored  queries  are  advanced  features  wh ich  are  not  likely  to 
be  used  by  inexperienced  simulator  users.  To  provide,  however,  for 
a realistic  environment  that  fully  replicates  RECON,  and  allows 
experienced  users  to  practice  more  with  the  system,  the  stored 
search  features  must  be  implemented.  Individual  user  groups  should 
be  all  owe  d space  on  the  data  disk  for  their  stored  searches,  and 
in  general  the  whole  stored  search  environment  will  be  replicated. 
The  problem  with  stored  searches  is  that  the  entire  user  interface 
(recon  c oniiia  n d level)  will  have  to  be  tailored  in 
ba t ch/ i n t e r a c t i ve  environment.  Such  a command  level  would  allow 
inputs  from  both  file  and  terminal,  and  be  able  to  store  and  edit 
queries  as  required.  Again,  complexity  and  efficiency  are  the  main 
factors,  but  the  result  will  be  a much  better  simulation  of  the 
RECON  sy  s t em. 

System  logging  in  can  be  performed  in  a variety  of  ways:  just 
enter  RECON  conmand  level  and  BEGIN  SEARCH,  or  simulate  all  the 
TELENET /NASA  Host  login  procedures  (?)  for  a more  •’realistic” 
environment.  The  same  is  also  true  for  quiting  the  system  and 
returning  to  operating  system  level. 
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Error  recovery  is  also  a ma  j o r it  em  to  be  considered.  In  case 
of  error,  NASA/ RECON  displays  a cryptic  message  and  nothing  else, 
expecting  the  user  to  have  a manual  and  see  the  error  from  the 
error  code.  This  is  definetely  not  going  to  help  the  users  of  the 
simulator.  The  proposed  design  can  have  two  levels:  a beginning 
level  where  all  messages  are  self-explanatory  with  examples  etc, 
and  an  advanced  level  where  the  same  message  structure  as  the 
RECON  s y s t em  is  foil  owe  d . S ome  me  ssages  can  be  extr  erne  1 y 
confusing  (even  to  M.Sc.  CMPS  Students)  and  the  help  facility  does 
not  do  much  to  explain.  The  help  text  can  again  be  arranged  in  two 
levels  as  well.  Then,  the  user  can  be  asked  if  he  wants  the 
beginner  or  advanced  level  and  proceed  with  the  system. 

User  monitoring  can  help  improve  the  simulator  (and  the 
NASA/RECON  system  as  well).  A facility  similar  to  MADAM’ s can  be 
incorporated.  The  number  of  queries,  errors,  and  other  measurable 
items  can  be  recorded  and  used  for  both  simulator  and  user 
evaluation.  After  a session  the  user  can  see  his/her  performance 
and  improve  based  on  the  results.  System  evaluation  can  also  be 
performed  in  a similar  fashion.  This  is  feasible  on  hard-disk 
based  PC/XT’s  only  as  the  additional  space  needed  for  Performance 
Measurement  and  Evaluation  can  be  fairly  large.  Hardware 
monitoring  functions  will  be  rather  difficult  (and  useless)  to 
incorporate,  since  the  simulator  is  only  a model.  User  monitoring 


I DH/IS  .NASA/PC  R&D-4  I 


20 


I \VDRKING  PAPER  SERIES  I 


I NASA  I 


I N A S A I 


is,  however,  much  more  important. 

The  data  base  will  be  populated  mainly  from  records 
downloaded  from  the  NASA/RECX)N  system.  The  thesaurus,  however,  can 
not  be  downloaded  and  mainly  depends  on  the  records  downloaded.  If 
this  is  not  possible,  then  MADAM  records  can  be  easily  downloaded 
and  used.  Again  a thesaurus  and  dictionary  will  have  to  be 
formulated  and  this  can  ba  a major  task. 
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GENERAL  SPECIFICATIONS 
FOR  THE  DEVELOPMENT 
OF  A USL  NASA  PC  R&D 
STATISTICAL  ANALYSIS  SUPPORT  PACKAGE 


ABSTRACT 


Th is  is  a three  level  package  designed  to  all ow  statistical 
analysis  for  a variety  of  applications  within  the  USL  DBMS 
NASA/RECON  project.  Designed  with  flexibility  and  uniformity  as 
the  main  considerations,  it  is  expected  to  provide  computational 
capabilities  for  a variety  of  user  needs,  beginner  to  expert,  in 
three  different  forms:  a library  package,  an  interactive  package 
and  a batch— proce s s ing  package. 
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GENERAL  SPECIFICATIONS 
FOR  THE  DEVELOPMENT 
OF  A USL  NASA  PC  R&D 
STATISTICAL  ANALYSIS  SUPPORT  PACKAGE 

I . INTRODUCTION 

This  is  a proposal  for  the  design,  development  and 
implementation  of  a general-purpose  statistical  package  for  the 
USL  DBMS  NASA/RECON  project. 

Statistical  Packages  offer  to  the  user  the  power  and 
flexibility  they  need,  without  having  to  write  complicated 
programs.  In  addition,  the  user  can  be  assured  of  the  accuracy  of 
the  results.  Many  statistical  packages  have  been  developed  so 
far,  for  all  types  and  sizes  of  computers. 

There  are  three  major  types  of  statistical  packages 
available  for  the  user: 

i.  Statistical  Program  Libraries. 

Statistical  Libraries  are  collections  of  progr ams  that 
are  bound  together  in  one  collection.  The  user  can  call 
them  from  his/her  application  programs,  supplying  the 
appropriate  argiunents  and  obtaining  the  results  in  a 
s imi  1 a r way  . 
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ii.  Interactive  Statistical  Packages. 

Interactive  Statistical  Packages  allow  the  user  to 
interact  with  the  computer.  The  user  is  put  on  at  a 
"command  level”,  where  he/she  issues  conxnands  and 
enters  data.  The  program  processes  the  data  and  returns 
the  results  to  the  user  on  the  terminal  screen. 

iii.  Batch  Statistical  Programs. 

Batch  programs  allow  the  user  to  collect  all  his/her 
conrmands  to  the  program  in  one  group,  code  them  in  a 
particular  language,  and  then  process  the  entire  batch. 
The  user  does  not  interact  with  the  execution  at  all. 

This  research  and  development  proposal  intends  to  implement 
all  three  packages  under  a unified  interface.  The  result  is 
expected  to  be  a flexible  and  powerful  package  with  conxnon 
characteristics  between  its  three  forms.  It  is  also  intented  to 
be  completely  transportable  among  any  computer  that  can  support 
the  ”C”  programning  language.  This  includes  3 of  the  4 large 
computer  systems  available  at  USL,  namely  the  DEC  UNIX 
VAX-11/780,  DEC  \MS  VAX-11/780,  the  Pyramid  Technologies  90x, 
and,  of  course,  the  IBM  PC/XT. 
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II.  OBJECTIVES  OF  THE  PROJECT 

The  generic  objectives  of  the  project  are  as  follows: 

i.  To  develop  a powerful,  flexible,  easy-to-use  and 
transportable  statistical  package. 

ii.  To  improve  our  knowledge  in  the  fields  of  statistics  and 
numerical  computation. 

iii.  To  obtain  further  experience  on  the  design,  implementation, 
testing  and  maintenance  of  a major  software  product. 

The  specific  objectives  of  the  statistical  package  design  are  as 

foil ows  : 

i.  Computational  power:  the  objective  is  a design  that  can 
satisfy  most  user  needs  in  terms  of  available  functions  and 
options.  The  package  should  offer  a full  range  of  comnands 
for  most  applied  statistical  computations. 

ii.  Design  flexibility:  The  design  must  be  flexible  so  that 
changes,  improvments  and  addition  of  more  functions  can  be 
acconmodated  without  major  changes,  if  any,  to  the  entire 
package . 

iii.  Ease  of  use:  the  design  should  be  such  that  any  of  the  three 
interfaces  will  be  easy  to  use  efficiently.  This  includes 
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error  checking  and,  in  the  case  of  the  interactive  user 
interfaces,  available  online  help.  Uniform  comnand  and 
function  formats  in  all  three  modes  will  be  used  also. 

iv.  Efficiency  and  accuracy:  Efficiency  of  the  algorithms 

used  is  very  important  considering  that  the  package  to  be 
developed  will  be  used  in  mini  and  micro  computers  with 
often  limited  resources  and  speed  of  execution  problems. 
Accuracy  is  also  critical  so  that  the  user  is  assured  of  the 
quality  of  the  results. 

V.  Package  Transportability:  The  programs  should  be  written  in 
a way  that  ensures  transportability  between  varying 

operating  environments.  Standard  prog ramni ng  policy  will  be 
adopted  for  all  modules. 

This  design  will  be  first  implemented  on  the  IBM  Personal 

Computers  of  the  NASA/ RECON  Project.  Parallel  development  on  the 

DEC  VAX- 11/780  will  also  be  considered. 


1 DH4S. NASA/PC  R&D-5  I 


7 


I WORKING  PAPER  SERIES  I 


I N A S A I 


I NASA  I 


III.  METHODOLOGY 

A highly  modular  approach  will  be  followed  in  the  design  and 
implementation  of  this  project.  This  will  ensure  that  many  of  the 
design  objectives,  in  particular,  flexibility  and  modifiability, 
are  inherent  in  the  implementation. 

For  achieving  the  transportability  and  modularity  goals,  the 
”C”  progranxning  language  was  chosen  as  the  implementation 
language.  It  offers  good  performance  characteristics  and  high 
modularity  which  make  it  most  desirable.  It  is  also  powerful  in 
character  and  file  manipulation,  facts  that  make  it  more 
desirable  to  use  in  the  second  and  third  phase  of  the  design. 

Algorithm  selection  is  critical  in  the  computational  parts. 
Therefore,  extensive  research  will  have  to  be  performed  in  order 
to  determine  the  most  appropriate  ones  to  be  used.  While  a 
computer  approach  to  manual  algorithms  can  be  used,  for  some 
cases  it  is  not  efficient  and  better  methods  should  be  found. 

At  this  point  only  the  first  phase  of  the  statistical 
package  has  been  totally  defined.  The  interactive  and  batch 
interfaces  will  be  designed  under  the  considerations  applied  to 
the  first  phase,  with  the  final  goal  being  to  create  a conmon, 
efficient  interface  for  all  three  modes.  A defined  conmand 
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language  for  the  interactive  phase  would  consist  of  either  a 
menu- s e 1 e c t i on  procedure,  a comnand  language  or  a combination. 
Again,  the  batch  interface  can  be  similar  to  the  interactive  in 
terms  of  comnand  names,  arguments,  etc,  or  be  a completely 
different  progranming  language  by  itself. 

For  the  interactive  interface,  a spreadsheet  configuration 
like  MINITAB  is  likely  to  be  implemented,  with  its  comnands, 
arguments  and  options  combined  to  form  the  batch  progranming 
language.  Therefore,  by  making  the  library  interface  with  a 
similar  structure,  the  goal  of  uniformity  can  be  achieved. 

As  a minimiun,  the  functions  shown  below  are  expected  to  be 
implemented  for  the  first  phase  (program  library).  Then  the 
interactive  and  batch  interfaces  can  be  built  on  top  of  the 
packages.  The  modularity  of  the  design  will  “allow  the  addition 
of  new  functions  and/or  the  modification  of  existing  ones  to  be 
performed  efficiently,  with  no  major  code  changes  in  the  entire 
program  structure. 
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PROPOSED  CX)NFIGURATION 
OF  PHASE  1 

1.  Basic  Input/Output 

Read  f r om  a given  file 

Read  from  terminal 

Wr  ite  to  a given  file 

Write  to  terminal 

Report  error/warning  messages 

2.  Basic  One-Vector  Calculations 

SumX,  SumX2,  sum2X 
Mean,  mode,  median 
Variance,  standard  deviation 
Sort  ascending,  descending,  rank 
Frequency,  mo  st/least  frequent 
Relative  frequencies,  signs 
Max-min,  local  max/min,  k-th  max/min 

3.  One-Vector  Test  Statistics 

Confidence  intervals 
z-scores,  z-tests 
Proport  ion  tests 
Student ’ s t-t  e s t 
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Sma  1 1/large 


s amp  1 e sizes 


4.  Basic  one-Vector  Graphs 

Bar  Charts  - Histograms 
Frequency  graphs 


5. 


Two-Way  Statistics 

Hypothesis  testing 

Difference  of  me  a n s 
Variance  known/unknown 
D-  test 

Paired  Samples  Tests 
Tests  for  Standard  Deviation 
Degrees  of  Freedom,  F-test 
Tests  for  proportions 


6 


Two-Vector  Graphics 
Plots 

Scatter  Grams 
Frequency  Plots 
Chart  s 
X-Y  plots 
Distributions 
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7.  Linear  Regression  and  Correlation 

Linear  Regression  Analysis  ' 

Regression  Line  calculations 
Correlation  Analysis 
S t anda r d Error 

8 • Mu Itiple  Regression 

Exponential  regression  analysis 
Logarithmic  regression  analysis 
Parabolic  regression  analysis 
Multiple  Analysis 

9.  Basic  Probability  Calculations 

Probability  distributions 
Norma  1 distribution 
Binomial  distribution 
Poisson  distribution 
Probability  tests 

p-test  Probability  confidence  intervals 

10.  Advanced  Probability  Calculations 

Condi t i ona 1 Probabilities 
Independent  Probabilities 
Probability  Estimations 
Baye  s * Theorem 
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Basic  Combinatoric  Calculations 
P (m,  n ) value 
C(m,  n ) value 
n ? value 

Probability  distributions  of  s amp  1 e s 

11.  Chi  Square  Analysis 

Cont ingency  Tabl e s 
Chi  Square  tests 
Chi  Square  distribution 
Lambda  Index  of  association 

,12.  Analysis  of  Variance 
One-way  analysis 
TWo-way  analysis 
Difference  of  several  means 
Total  Variance  calculations 

13.  Non-Par ame  t r i c Tests 
Sign  test 
Mann-Whi tney  test 
Non-par ame  trie  ANOVA 
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IV.  SUMMARY 

Design,  implementation,  testing  and  maintenance  of  this 
major  software  package  is  expected  to  generate  a support 
environment  for  any  other  activities  that  require  statistical 
analysis  within  the  NASA/RECON  or  related  DBMS  projects.  The 
applicability  of  statistical  analysis  methods  in  informat  ion 
storage  and  retrieval  systems  is  increasing,  ranging  from 
performance  measurement  and  evaluation  to  natural  language  text 
analysis,  thus  making  this  project  an  interesting  consideration 
for  further  research  and  development. 

The  unified  environment  that  this  document  proposes  is 
expected  to  further  improve  the  user/system  interface  and  make  it 
more  effective.  Portability  is  also  provided  in  order  to  have  a 
single  data  analysis  environment  for  more  than  one  hardware 
c onf i gur a t i on . 
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GENERAL  SPECIFICATIONS  FOR  THE  DEVELOPMENT 

OF  A 

USL  NASA  PC  R&D  DISTRIBUTED  WORKSTATION 


ABSTRACT 


This  document  defines  the  general  specifications  for  the 
development  of  a PC-Based  distributed  workstation  (PCEWS)  for  an 
information  storage  and  retrieval  systems  environment.  This 
research  proposes  the  development  of  a PCEWS  prototype  as  part  of 
the  USL/DEMS  NASA/PC  R&D  project  in  the  PC— Based  workstation 
env i r onment . 
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GENERAL  SPECI FICATIONS  FOR  THE  DEVELOPMENT 

OF  A 

USL  NASA  PC  R&D  DISTRIBUTED  W3RKSTATION 
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storage  and  retrieval  systems  is  extremly  viable. 

Ou r ma in  goal  is  to  develop  a distributed  wo rkstation 
environment  for  scientists  and  engineers  to  assist  themwith 
day-to-day  problem  solving  tasks  as  well  as  for  accessing  remote 
and/or  local  information  systems.  We  propose  to  develop  a 
comprehensive  set  of  tools  as  functional  components  for  the 
prototyping  of  a robust  distributed  workstation  in  an  information 
storage  and  retrieval  environment. 


II.  GENERAL  AND  SPECIFIC  R&D  OBJECTIVES 

The  general  and  specific  research  and  development  objectives 
of  this  research  are  sunmarized  in  the  following  sub- s e c t i ons . 

2 . 1 C?,enera  1 Goal  s and  Objectives 

1.  Provide  a mechanism  for  very  wide  distribution  of  the 
information  storage  and  retrieval  capabilites  of  the 
NASA/RECON  system. 

2.  Provide  the  potential  perfo  rma  nee  imp  r o v erne  n t of 

performing  selected  functions  local  to  the  users. 
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3.  Provide  simulated  information  storage  and  retrieval 
sy  s t em  env  i r omnent  s . 

4.  Provide  state-of-the-art  technology  available  to  the 
NASA/  RECX)N  s y s t em . 

2 . 2 .Specific  E&H  Objectives 

1-  Provide  a robust  personal  computer  workstation 
environment  with  a comprehensive  set  of  tools  as 
functional  components  to  serve  as  a scientist’s  / 
engineer’s  R&D  workbench. 

2.  Provide  access  to  multiple  DBMS  and/or  IS&R  systems. 

3*  Provide  d i s t r i bu t ed/ne  two rked  workstation 

i n t e r c omnun i c a t i on  and  up  1 oad i ng /down  1 oad ing  protocols 
between  workstations  and  remote  mainframes  as  well  as 
between  workstations. 


I DBMS. NASA/PC  R&D-6  I 


6 


I \SORKING  PAPER  SERIES  I 


I NASA  I 


I NASA  I 


III.  RESEARCH  & DEVELOPMENT  METHODLOGY 
The  research  and  development  will  be  performed  in  three 

t 

phases,  n ame  ly,  the  specifications  phase,  design  and 
implementation  phase,  and  deployment  phase.  Various  stages  of 
each  phase  are  sumarized  below.  Figure  1 illustrates  the 
interactions  of  the  stages  within  the  three  phases. 

3 . 1 Pha  s e.  i_  ifications 

1.  User  Requirement  Analysis 

2.  NASA/RECX)N  Requirement  Analysis 

3.  Distributed  Workstation  Functional  Specifications 

4.  Evaluation  of  Candidate  Workstation  Systems 

5.  Selection  of  Candidate  Systems 

6.  Model  System  and  Network  Architecture 

3.2  Phasg  XLl  Design  and  Implementation 

1.  Implementation  Study  and  Design  Specifications 

2.  System  Implementation 
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3.  Testing  and  Debugging 

4.  Prototyping  of  Finished  System 

3.3  Phasg  m ; Deployment 


1.  Development  Deployment  and  Support  Strategies 

2.  Operational  Maintenance  and  Enhancement 

3.  Performance  Measurement  and  Evaluation 
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FIGURE  1.  RESEARCH  AND  DEVELOFWfT 


PHASES  AND  THEIR  INTERACTIONS 
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IV.  SllvMyiY  AND  CONCLUSION 

This  document  describes  general  specifications  for  the 
development  of  a PC-based  distributed  workstation  in  the 
information  storage  and  retrieval  environment.  General  and 
selected  specific  research  and  devel opment  objectives  are 
specified  and  a methodology  is  briefly  overviewed  for  the 
prototyping  of  a such  system. 

We  believe  that  this  research  will  be  extremely  significant 
within  both  current  and  future  information  system  oriented  R&D 
workstation  environments. 
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The  USL  NASA  PC  R&D 

INTERACTIVE  PRESENTATION  DEVELOPMENT  SYSTEM 


ABSTRACT 


IPDS  is  a very  interactive  system  for  creating,  editing,  and 
displaying  video  presentation  sequences.  It  is  designed  for  users 
with  little  or  no  computer  experience,  and  can  be  used 
effectively  with  just  a fewminutes  practice. 

Users  interact  with  IPDS  through  the  keyboard,  creating  text 
with  normal  keys  and  invoking  special  functions  with  <alt> 
c omb  inations  and  function  keys.  Once  a particular  screen  is 
created  it  can  be  stored  into  a screen  file  for  subsequent 
r e t r i e va 1 . 

Script  files  may  be  created,  containing  a list  of  screen 
file  names  to  be  used  in  a presentation  sequence.  Users  can  step 
through  the  sequence  forward  or  backward,  focusing  attention  to 
areas  of  the  screen  with  special  cursor  pointers.  Screens  may  be 
dynamically  modified  during  the  presentation  to  show  assignments 
or  to  answer  questions,  much  like  a traditional  blackboard. 
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TABLE  OF  CX)NTENTS 

I . SET  FOREGROUND  COLOR 

I I . SET  BACKGROUND  COLOR 

III.  CLEAR  SCREEN 

IV.  SET  BORDER  COLOR 4 

V.  SELECT  VIDEO  PAGE 5 

VI  . STORE  SCREEN 

VII.  RETREIVE  SCREEN 5 

VIII.  EXIT  IPDS 5 

IX.  CREATE  BLOCK 

X.  SET  CURSOR  TYPE 

XI.  SELECT  SCRIPT  6 

XII.  QUICK  REFERENCE  LIST 8 
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The  purpose  of  IPDS  is  to  provide  an  easy  to  use  system  for 
creating  and  controlling  video  presentations.  A description  of 
IPDS  features  follows: 


I . SET  FOREGROUND  COLOR 

The  <F1>  key  allows  the  user  to  select  one  of  16 
foreground  colors  for  subsequent  characters. 

I I . SET  BACKGROUND  COLOR 

The  <F2>  key  allows  the  user  to  select  one  of  8 
background  colors  for  subsequent  characters. 

III.  CLEAR  SCREEN 

The  <F3>  key  clears  the  the  screen  work  area  to  the 
current  background  color. 

IV.  SET  BORDER  COLOR 

The  <F4>  key  allows  the  user  to  select  one  of  8 colors 
for  the  border  surrounding  the  screen  work  area. 
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V.  SELECT  VIDEO  PAGE 

The  <F5>  key  allows  the  user  to  select  the  currently 
displayed  video  page;  four  are  available. 

VI • STORE  SCREEN 

Pressing  the  <F7>  key  will  initiate  the  screen  storage 
sequence.  The  prompt  ^filename:'*  will  then  be  displayed.  If 
the  response  is  a valid  file  specification  then  the  current 
video  screen  is  saved  in  this  file.  If  <return>  is  entered 
then  no  action  is  taken. 

VII.  RETREIVE  SCREEN 

Pressing  the  <F8>  key  will  initiate  the  screen 
retrieval  sequence.  The  prompt  "filename:”  will  then  be 
displayed.  If  the  response  is  a valid  and  existent  file 
specification  the  current  video  screen  will  be  loaded  with 
the  screen  stored  in  this  file. 

VIII.  EXIT  IPDS 

f 

Pressing  <F9>  will  return  the  user  to  DOS. 
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IX.  CREATE  BLOCK 

A block  primitive  is  available  to  draw  double  line 
boxes.  Its  use  requires  three  steps: 

1)  Position  the  cursor  at  the  upper  right  hand  corner 
of  the  intended  block  and  press  <ALT>7.  This  sets  the 
first  marker . 

2)  Position  the  cursor  at  the  lower  left  hand  corner  of 
the  intended  block  and  press  <ALT>6.  This  sets  the 
second  marker . 

3)  Press  <ALT>8.  This  will  draw  the  double  line  block 
with  the  previously  specified  corners. 

X.  SET  CURSOR  TYPE 

Pressing  the  <ALT>9  combination  allows  the  user  to 
select  the  current  cursor  character.  There  are  several 
pointers,  an  underscore,  and  a cross  available. 

XI.  SELECT  SCRIPT 

Pressing  the  <ALT>0  combination  will  initiate  the 
script  selection  sequence.  The  prompt  "script:”  will  then  be 
displayed.  If  the  response  is  a valid  script  file 
specification  then  the  current  script  will  be  this  file. 
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Pressing  <PgDn>  will  cause  the  next  screen  to  be  read 
f r om  the  script  list  and  displayed  in  the  current  video 
screen. 

Pressing  <PgUp>  will  cause  the  previous  screen  to  be 
read  from  the  script  list  and  displayed  in  the  current  video 
screen. 

Screens  are  created  through  any  standard  text  editor 
and  include  quoted  screen  names  with  border  color  numbers. 
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XII.  QUICK  REFERENCE  LIST 


<F1  > 
<F2> 
<F3> 
<F4> 
<F5> 
<F7> 
<F8> 
<F9> 


- Next  foreground  color. 

- Next  background  color. 

- Clear  screen. 

- Next  border  color. 

- Next  video  page. 

- Store  screen. 

- Retrieve  screen. 

-Exit  IPDS. 


<ALT>6 
<ALT>7 
<ALT>  8 
<ALT>9 
<ALT>0 


- Set  block  marker  2. 

- Set  block  marker  1. 

- Draw  double  line  block. 

- Next  cursor  type. 

- Select  script  file. 


<PgDn>  - Display  next  screen  in  the  script  file. 
<PgUp>  - Display  previous  screen  in  the  script  file. 
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THE  USL  NASA  PC  R&D  PROJECT: 
DETAILED  SPECIFICATIONS  OF  OBJECTIVES 


ABSTRACT 


This  document  represents  the  specifications  for  a number  of 
tasks  which  are  to  be  implemented  within  the  USL  NASA  PC  R&D 
Project.  The  goals  and  objectives  of  the  PC  development  project’ 
and  the  interrelationships  of  the  various  components  are 
discussed.  Six  individual  tasks  are  described.  They  are  a 
NASA/RECON  simulator,  a user  interface  to  multiple  remote 
information  systems,  evaluation  of  various  personal  computer 
systems,  statistical  analysis  sof  t wa  re  develo  pme  nt,  interactive 
presentation  system  development,  and  the  development  of  a 
distributed  processing  environment.  The  relationships  of  these 
projects  to  each  other  and  to  the  goals  and  objectives  of  the 
overall  project  are  also  discussed. 
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THE  USL  NASA  PC  R&D  PROJECT: 
DETAILED  SPECIFICATIONS  OF  OBJECTIVES 

I . INTRODUCTION 


The  USL  NASA  PC  R&D  Project  was  initiated  in  an  effort  to 
explore  the  possible  utilizations  of  personal  c omp uters  as  tools 
for  use  by  engineers  and  scientists  in  the  processing  of 
information.  Recent  advances  in  personal  computer  technology  and 
resultant  increases  in  the  performance/cost  ratio  of  these 
machines  has  made  them  increasingly  attractive  replacements  for 
terminals  as  a method  of  accessing  remote  information  systems. 
The  information  processing  capabilities  associated  with  personal 
computers  make  them  part icularly  attractive  to  engineering  and 
scientific  personnel  who  desire  both  local  processing 
capabilities  and  access  to  remote  information. 

The  primary  direction  of  research  efforts  initiated  by  the 
project  has  been  the  development  of  a research  environment  to  be 
utilized  by  the  project  and  the  development  of  specifications  for 
a nmnber  of  activities  addressing  individual  tasks  within  the 
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overall  scope  of  the  project.  The  research  enviroiunent 
development  is  a continuous  process  which  includes  the  evaluation 
and  testing  of  both  hardware  and  software  tools.  All 
specifications  are  developed  with  the  goal  of  maintaining  maximum 
flexibility  and  portability.  The  environment  available  for  use 
by  project  members  will  therefore  continue  to  evolve  over  time. 


I DBMS. NASA/PC  R&D-8  I 


5 


I WORKING  PAPER  SERIES  I 


I N A S A I 


I NASA  I 


II.  GENERAL  GOALS  AJ®  OBJECTIVES 


The  purpose  of  this  project  is  to  develop  personal  computer 
based  tools  which  will  be  valuable  to  scientific  and  engineering 
professionals.  The  following  general  goals  will  be  used  as  a 
framework  for  these  development  efforts: 

1.  Create  an  environment  for  PC  research  and  development 
activities. 

2.  Develop  an  integrated  PC— based  environment  for 

scientific  and  engineering  professionals. 

3.  Provide  PC-Based  instructional  tools  for  training  in  the 
use  of  information  storage  and  retrieval  systems 
( IS&Rs ) . 

These  goals  will  be  achieved  by  specifying  objectives  and 
initiating  tasks  to  accomplish  those  objectives.  The  following  is 
a list  of  currently  identified  objectives. 
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OBJECTIVES: 

!•  The  objectives  for  establishing  a PC  R&D  environment 

inc 1 ude : 

1.1  Continually  evaluate  available  PC  hardware  and 
software  for  potential  incorporation  into  the  PC 
R&D  projects . 

1.2  Develop  procedures  and  specifications  for  PC  R&D 
activities. 

1.3  Identify  and  evaluate  candidate  research  and 
de ve 1 opment  projects . 

2.  The  objectives  for  developing  an  integrated  PC-based 

envi ronment  include: 

2.1  Develop  a general  means  of  transporting  data 
between  tools  in  the  local  environment. 

2.2  Develop  applications  tools  for  prototyping  an 
integrated  PC-based  environment. 

2.3  Develop  a general  system  for  transparent  sharing 
and  access  of  resources  in  a distributed 
environment . 
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2.4  Develop  a consistent  means  for  accessing  resources 
located  in  a remote  processing  environment. 

3.  The  objectives  for  providing  CAI  tools  for  IS&R  training 
include  : 

3.1  Develop  a simulator  for  Computer  Aided  Instruction 
(CAI)  in  the  use  of  IS&R  systems. 

3.2  Develop  a simulator  generator,  retargetable  for 
various  IS&R  systems. 
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III.  SPECIFIC  OBJECTIVES  OF  INITIATED  TASKS 

Th is  section  describes  the  status  of  tasks  currently  in 
progress  within  the  PC  R&D  project  and  outlines  the  objectives 
which  each  task  is  intended  to  accomplish.  Each  of  these  tasks 
is  represented  by  one  or  more  entries  in  the  USL  NASA  PC  PA-r> 
Working  Paper  Series  and  complete  information  on  the 
specifications  is  available  in  these  documents. 

3 . 1 Evalnation  Jlf.  Cyrrgnt  ly  Ava  i l abl  e ££  Hardware /Software 

This  task  addresses  Goal  1 Objective  1.1  described  in 
Chapter  II.  Rapid  changes  in  PC  hardware  and  software  technology 
mandate  a continual  evaluation  of  available  products  in'this 
area.  New  technological  offerings  may  potentially  be 
incorporated  into  ongoing  R&D  efforts  or  may  make  previously 
impractical  explorations  feasible. 

Our  primary  criteria  for  evaluation  will  include 
qualitative,  as  well  as,  quantitative  parameters.  Qualitatively, 
we  will  be  concerned  with  characteristics  such  as  ease  of  use, 
documentation  quality,  training  facilities,  flexibility, 
manufacturer  support,  and  maintainability.  Quantitatively,  we 


I DHVIS  .NASA/PC  R&D- 8 I 


9 


I WRKING  PAPER  SERIES  I 


I N A S A I 


I N A S A I 


will  evaluate  products  in  terms  of  benchmark  performances, 
p r i c e / pe r f o rma nc e ratios,  compa t ab i 1 i ty  with  existing  systems, 
reliability,  and  expandability. 

This  data  will  be  compared  against  the  results  from  previous 
evaluations  and  used  in  determining  product  adaptability  to  our 
PC  R&D  needs. 


3 . 2 .Statistical  Analysis  Sof  twar  e 

This  task  addresses  Goal  2 Objective  2.2  in  Chapter  II. 
Statistical  analysis  is  a widely  used  process,  especially  in  an 
engineering  or  scientific  environment.  However,  few  packages  have 
the  potential  for  integrating  with  other  existing  packages  for 
other  tasks,  or  operate  in  a multiple  mode  environment. 

The  USL  NASA  PC  R&D  statistical  package  was  designed  with 
computational  power,  design  flexibility,  ease  of  use,  efficiency, 
accuracy,  and  transportability  as  the  main  design  goals  [Bassari 
et  al.,  84].  Multiple  mode  operation  will  allow  the  user  to  apply 
the  same  methods  to  a stand-alone  interactive  package,  a batch 
language,  and  a library  package. 

The  applicability  of  statistical  analysis  to  other  fields 
such  as  information  storage  and  retrieval  or  text  processing 
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makes  integration  of  the  statistical  package  with  other  packages 
mandatory.  A high  degree  of  cooperation  will  exist  between 
applications,  in  order  to  improve  the  total  workstation 
e f f i c i ency . 

The  package  developed  will  have  the  capability  of  processing 
requests  for  one-  and  two-way  statistics,  regression  analysis, 
AhJOVA,  and  other  facilities  required  by  the  user  conmunity.  In 
addition,  due  to  a modular  design,  new  local  functions  can  be 
added  without  major  modifications. 


3 . 3 ProtPtypg  Interact ive  Presentation  System 

This  task  addresses  Goal  2 Objective  2.2  in  Chapter  II 
above.  Users  in  an  integrated  workstation  environment  should 
have  access  to  tools  which  assist  them  in  all  information  related 
job  functions.  The  Interactive  Presentation  Development  System 
(IPDS)  was  developed  as  a tool  for  a prototype  workstation 
environment  in  which  data  will  be  easily  transferred  between 
tools  [Moreau,  84b], 

IPDS  is  a very  interactive  system  for  creating,  editing,  and 
displaying  video  presentation  sequences.  It  is  designed  for  users 
with  little  or  no  computer  experience,  and  can  be  used 
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effectively  with  just  a fev/  minutes  practice. 

Users  interact  with  IPDS  through  the  keyboard,  creating  text 
with  normal  keys  and  invoking  special  functions  with  <alt> 
combinations  and  function  keys.  Once  a particular  screen  is 
created  it  can  be  stored  into  a screen  file  for  subsequent 
retrieval  . 

Script  files  may  be  created,  containing  a list  of  screen 
file  names  to  be  used  in  a presentation  sequence.  Users  can  step 
through  the  sequence  forward  or  backward,  focusing  attention  to 
areas  of  the  screen  with  special  cursor  pointers.  Screens  may  be 
dynamically  modified  during  the  presentation  to  show  assignments 
or  to  answer  questions,  much  like  a traditional  blackboard. 


3 .4  Distributed  Workstation 

This  task  addresses  Goal  2 Objective  2.3  in  Chapter  II 
described  above.  The  proposed  PC-Based  Distributed  Workstation 
(PCrWS)  prototype  will  give  the  users  (scientists  and  engineers) 
an  integrated  PC-Based  workstation  environment  for  transparent 
access  and  sharing  of  resources  available  from  both  local  and 
remote  facilities  [Chum,  84]. 
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The  PCjaVS  will  provide  a robust  personal  computer 
workstation  environment  with  a comprehensive  set  of  tools  as 
functional  components  to  serve  as  a s c i ent i s t ’ s / eng ine e r ’ s R&D 
workbench.  It  will  also  provide  distributed/networked 
workstation  int er conmuni cat i on  and  up  1 oad i ng /down  1 oading 
protocols  between  workstation  and  remote  mainframes  as  well  as 
between  workstations,  thus  providing  access  to  multiple  local 
and/or  remote  DBMSs  and  IS&R  systems. 


3.5  PC-Based  User  Interface 


This  task  addresses  Goal  2 Objective  2.4  of  the  Project  as 
described  in  Ch  apter  II  of  this  doc  ume  n t . Th is  objective 
addresses  the  provision  of  a consistent  means  for  accessing 
resources  located  in  a remote  processing  environment.  This 
specific  task  involves  the  design  and  prototyping  of  a conmon 
user  interface  to  multiple  information  storage  and  retrieval 
systems  [Hall,  84]. 


A set  of  design  criteria  will  be  developed  which  will  guide 
the  development  of  an  interface  system  to  provide  the  user  with 
the  functionality  required  to  retrieve,  store  and  manipulate  data 
residing  in  remote  information  systems.  The  design  will  provide 
the  user  with  a conmon  interface  to  be  used  in  interaction  with 
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all  information  systems  he  v/ishes  to  access.  The  user  will 
therefore  "see”  all  systems  through  the  same  interface  and  will 
be  spared  the  necessity  of  learning  multiple  system  conmand 
languages  and  access  procedures. 

The  system  will  have  multi-level  capabilities  to  provide 
access  to  users  with  varying  expertise.  The  user  will  also  be 
able  to  utilize  the  processing  capabilities  of  his  personal 
computer  to  accomplish  whatever  local  processing  of  the  retrieved 
information  is  desired.  The  system  will  be  designed  to  allow 
incorporation  of  additional  systems  as  the  user’s  needs  for 
information  evolve.  The  interface  system  is  intended  to  be  a 
part  of  the  larger  workstation  development  project  being 
developed  by  the  USL  NASA  PC  R&D  team. 


3.6  PCrBased  NASA/RECON  Simulator 

This  task  addresses  Goal  3 Objective  3.1  of  the  Project,  as 
found  in  Chapter  II.  The  design  and  implementation  of  an 
information  system  simulator  has  many  goals  and  also  needs 
consideration  of  many  factors. 

The  main  goals  of  an  information  system  simulator  can  be 
defined  as  tools  for  effective  training  of  users.  The  increasing 
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cost  of  accessing  public,  remote  information  storage  and 
retrieval  systems,  as  well  as  the  increased  functionality  that 
these  systems  have  aquired  in  the  process  of  information 
manipulation  makes  training  expensive  as  well  as  neccesary.  The 
simulator  can  guide  the  user  through  a series  of  complete 
lessons,  if  so  desied,  until  he/she  is  ready  for  encountering  the 
**real”  environment.  All  this  training  can  be  done  without 
expensive  costs,  at  any  local  PC-based  site.  Also,  in  case  of 
advanced  usage,  the  features  can  be  first  seen  and  learned  in  the 
simulator,  thus  increasing  the  efficiency  and  improving  the 
CO s t / pe r f o rmanc e ratio  of  the  user. 

Other  goals  addressed  in  the  design  of  such  a simulator 
include  prototyping,  user/machine  interface  effectiveness 
measurement,  testing  of  new  search  strategies,  testing  of  new 
procedure  s , etc. 

Research  and  development  will  also  be  performed  in  the  field 
of  information  system  simulator  generators,  that  will  allow 
parameterization  of  existing  information  systems,  and  simulator 
generators  derived  out  of  these  specifications.  These  systems 
will  be  able  to  simulate  a given  existing  system,  as  well  as 
prototype  a non— existing  one  for  modeling  purposes. 
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IV.  RELATIONSHIPS  OF  INITIATED  TASKS  TO  GOALS 

Figure  1 illustrates  the  relationship  between  PC  R&D  project 
goals.  Each  task  is  identified  in  the  previous  chapter  as 
supporting  a particular  objective  of  one  of  these  goals. 

The  PC  hardware/ sof tware  evaluation  task  is  essential  in 
establishing  a PC  R&D  environment.  It  will  not  only  help  us  in 
the  selection  of  initial  products,  but  give  us  a procedure  for 
evaluating  future  products. 

Both  the  statistical  analysis  package  and  the  Interactive 

Presentation  Development  System  are  tools  for  incorporation  in 

« 

the  prototype  integrated  PC  workstation.  They  provide  a testbed 
for  exploring  data  transfer  mechanisms. 

The  distributed  workstation  prototype  specifications  address 
a distributed  environment  for  transparent  sharing  and  accessing 
of  non~local  resources.  With  the  advances  of  local  area  network 
technology,  this  has  become  a significant  component  of  the 
overall  integrated  workstation  design. 

The  PC— based  user  interface  is  the  first  step  in  addressing 
access  to  remote  processing  resources.  It  will  deal  with 
problems  that  must  be  addressed  in  all  phases  of  the  overall 
integrated  workstation  design  and  so  will  refine  our  approach  to 
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others  areas  as  well. 

The  PC-based  NASA/ RECON  simulator  development  is  intended  to 
fulfill  an  imnediate  need  of  providing  a means  of  training 
individuals  in  the  utilization  of  this  specific  system.  It  will 
be  a basis  for  the  future  development  of  a retargetable  simulator 
generator  for  use  in  training  courses  developed  for  other 
info rma tion  syst ems  . 
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Ob  jectives : 


Ob  jectives  : 


-Cont i nua 1 

e v,a  1 u a t i o n . ( Ob  j 1.1) 

-Develop  procedures 
& specifications. 

(Obj  1.2) 

-Identify  & evaluate 
candidate  projects. 

(Obj  1.3) 


-Local  environment 
interface . (Ob j 2.1) 

-Prototype  PC 
wo  rkstation. 

(Obj  2.2) 

-Distributed  WS 
environment  interface. 

(Obj  2.3) 


-IS&R  Simulator. 

(Obj  3.1) 

- 1 S&R  S imu  1 a t o r 
Generator . 

(Obj  2.2) 


-Remote  environment 
interface . (Ob j 2.4) 


Figure  1.  Relationship  Between  PC  R&D  Goals 
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V.  SUMMARY  AND  CONCLUSIONS 

Each  of  the  tasks  described  in  this  doc ume nt  addresses  a 
particular  objective  of  our  primary  purpose,  which  is  to  explore 
the  utilization  of  personal  computer  by  scientists  and  engineers 
in  their  information  processing  activities.  These  tasks  will 
help  to  establish  an  environment  for  addressing  our  goals,  help 
to  refine  our  perception  of  the  problems  to  be  solved  and 
establish  a framework  for  the  initiation  of  the  future  tasks  of 
the  USL  NASA  PC  R&D  project. 
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ATTACHMENT  6.1 


NASA/RECON  SPECIAL  TRAINING  WORKSHOP 
AT  USL:  WORKSHOP  AGENDA, 

LIST  OF  PARTICIPANTS,  AND 
COMPLETION  CERTIFICATES 


January  1984 


RECON  TRAINING  WORKSHOP  AGENDA  (SPECIAL) 

UNIVERSITY  OF  SOUTHWESTERN  LOUISIANA 
Lafayette,  Louisiana 

Tues.  8:45  a.m.  to  Thurs . , 12:00  noon 

JANUARY  31  - FEBRUARY  2,  1984 


TUESDAY,  JANUARY  31,  1984  ***  USL  UNION  SHADOWS  RoOM 


;8:45  - 

09:15 

Welcome  and  Training  Overview 

Dominick/Roque 

more/Eckert 
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*** 
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USL  Union  Shadows  Room 

RECON  Advanced  Commands  Eckert 
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• Text  Search  (Includes  numeric  words  and 

proximity  searching) 

• Root  Search/Range  Search 

Group  Tutorials 
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Group  B - Eckert 
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Group  Tutorials 
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December  1984 
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Group  B - Wynne 
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Stored  Search  Techniques 
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THURSDAY,  FEBRUARY  2,  1984  *** 

USL  Union  Cypress 
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Stored  Search  Techniques  Review 

Wynne 
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Group  Tutorials 

• 

Store  Sample  Search  and  Execute  for  1983;  also  i 

For 

December  1983 
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11  :00 

Pocket  Guide  Review 

1 :00  - 
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Review/Wrapup 
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ATTACHMENT  6.2 


NASA/RECON  SPECIAL  TRAINING  WORKSHOP 
AT  USL:  PARTICIPANTS  EVALUATION  FORM 


SUMMARY  RESULTS 


Computer  Science  Department 
P.O.  Box  44330 
(318)  231-6284 


The  University  of  Southwestern  Louisiana 

Lafayette,  Louisiana  70504 


4*  4* 
4* 


Umversile  <ks  Acadiens 


February  20,  1984 

Mr.  Philip  Eckert  and 
Mr.  Hal  Wynne 
NASA  STI  Facility 
P.  0.  Box  8757 
Baltimore/Washington 

International  Airport 
Maryland  21240 

Dear  Phil  and. Hal: 

As  I mentioned  in  my  February  7 letter  to  you,  we  would  be 
providing  you  with  additional  feedback  concerning  the  NASA  RECON. 
Workshop  which  you  conducted  at  USL  on  January  31  - February  2, 
1984.  That  additional  feedback  is  attached  (sorry  for  the  delay, 

but  I have  been  out  of  town  for  almost  10  days  out  the  past  two 
weeks) • 

As  part  of  obtaining  this  additional  feedback,  we  developed 
a simple  Workshop  Participant's  Evaluation  Form  which  was  dis- 
tributed  to  all  22  participants  within  the  workshoo.  After 
copecting  all  completed  forms,  we  complied  the  information 
Illustrated  within  the  attached  document. 

In  essense,  the  attachment  presents  the  following  four 
basic  categories  of  information: 

(1)  Sio^ary  results  from  the  completed  evaluation  forms  (pages 
1-2  of  the  attached  document  represent  the  actual  evaluation 
form  Itself,  with  the  sxunmary  results  superimposed  in  the 
right  margin  - the  form  consisted  of  12  specific  questions 
requiring  a rating  along  a four-point  scale,  plus  two  open- 
ended  questions) . 

(2)  A statistical  analysis  of  the  questionnaire  results  (page 
3 of  the  attached  document  represents,  for  each  numbered 
question,  the  sample  size  (22  in  all  cases) , the  mean  value 
on  a scale  of  1 to  4,  and  the  standard  deviation;  plus  a 

simple  95%  confidence  interval  for  the  level  means  of  each 
question) . 

Verbatim  text  of  the  participant's  supplied  responses  to 
the  open-ended  question  requesting  specific  comments  on 
the  ni^ered  items  on  the  questionnaire  (pages  4-6  of  the 
attached  dociiment) . 


(3) 


Philip  Eckert/Hal  Wynne 
February  20,  1984 
Page  2. 


(4)  Verbatim  text  of  the  participant's  supplied  responses  to 
the  open-ended  question  requesting  general  comments  on 
the  workshop  (pages  7-8.  of  the  attached  document) . 

From  looking  at  the  summary  results,  I think  that  both 
of  you  should  feel  quite  proud  at  having  conducted  such  a 
successful  workshop.  For  example,  the  overall  rating 
(Question  12:  "Overall  Rating  of  the  Workshop")  of  3.773  on 
a scale  of  4.0  is  quite  spectacular!  The  full  comments  also 
certainly  confirm  this  high  evaluation  of  the  quality  of  the 
workshop  on  the  part  of  the  workshop  participants. 

Again,  both  Leroy  and  I wish  to  thank  both  of  you  one  more 
time  for  the  terrific  job  that  both  of  you  did  and  for  all  of 
time  that  you  gave  us  and  all  of  our  people . We  have 
certainly  benefited,  .from  that  time  immensely  and  will  put  that 
knowledge  to  excellent  use  within  the  NASA  RECON  contract 
activities . 

Sincerely, 

D.  Dominick 

USL  NASA  Contract  Principal  Investigator 

cc:  Mr.  John  H.  Wilson,  Jr.,  NASA,  HQ 

Dr.  Leroy  Roquemore,  Southern  University  NASA 
Contract  Principal  Investigator 
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Attachment 


PARTICIPANTS  EVALUATION  FORM:  SUMMARY  RESULTS 


NASA/RECON  TRAINING  WORKSHOP  (SPECIAL) 
UNIVERSITY  OF  SOUTHWESTERN  LOUISIANA 
Lafayette,  Louisiana 

Tues.  8:45  to  Thurs.,  12:00  noon 
January  31  - February  2,  1984 


Name 


Date 


With  respect  to  the  NASA/RECON  Training  Workshop  recently  held  at 
USL,  please  provide  your  professional  evaluation  of  the  following 
items  using  the  evaluation  scale  presented  bel ow : 
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of  the  NASA/RECON  System 

11.  Contribution  to  the  Learning 
of  Interactive  Info  rma t ion 
Storage  and  Retrieval  Syst  ems 
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Overall  Rating  of  the  Workshop 


3 . 77 
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Please  supply  any  specific  comments  that  you  may  have  and/or 
suggested  improvements  in  any  of  the  above  numbered  evaluation 
areas  : 

Item  number  Comment /Sugg e s t i on 


X-SEE.AIIACHEE_LISI 


Please  supply  any  additional  general  comments  that  you  may  have 
concerning  the  workshop. 


X_SEE«AIlA£HEE_LiSI 

.-EE^fiEMEBAL_£fiMMElilS_l. 
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STATISTICAL  ANALYSIS  OF  THE  QUESTIONNAIRE  RESULTS 


QUESTION 

NUMBER 
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MEAN 

ST.  DEV 
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SPECIFIC  COMMENTS  ON  NUMBERED  ITEMS 


Item  number  1 

I feel  that  the  overall  quality  of  instruction  was  excellent. 
The  instructors  provided  the  lectures  very  clearly  and  covered 
the  material  very  thoroughly.  I think  that  the  ability  of  the 
instructors  to  relate  to  each  participant  during  the  on-line 
usage  sessions  was  great. 


Item  number  2 

Quality  of  training  packages,  handouts  can  be  improved  by 
using  good  print  to  prepare  handouts.  By  introducing  some  more 
examples  in  each  section,  quality  of  training  packages  can  be 
improved . 


Very  good  examples  of  session  in  hand  outs. 


Item  number  4 

I am  glad  we  had  lots  of  handouts,  because  so  much  material 
wes  covered  so  fast,  it  really  helped  to  be  able  to  go  over  the 
material  at  leisure. 


Item  number  5 

More  instruction  on  the  different  file  collections. 


Item  number  6 

Although  the  training  session  was  very  short  (3  days)  and 
topics  related  to  the  NASA/RECON  were  very  broad,  the  major 
topics  such  as  "search"  were  explained  in  detail.  Thus,  I think 
that  it  is  very  helpful  to  me  to  understand  the  functions  of 
NASA/RECON  and  to  use  the  system  in  the  future. 


We  spent  some  time  on  "non-heav i 1 y- int e r e s t i ng " material  while 
we  could  have  this  time  available  for  other  topics,  such  as  the 
INSIDE  of  RECON,,  some  more  implementat ion  details,  etc. 


A lot  of  material  was  covered  in  about  2 1/2  days,  should 
spread  out  in  3 whole  days. 
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Only  lack  of  time  obliged  us  to  skip  and  refrain  from  asking 
que  s t i ons . 


Item  number  7 

More  time  devoted  to  on-line  usage. 


Need  more  sample  questions  and  answers  after  online  usage 
s e s s i ons . \ 


I enjoyed  the  program  very  much  and  found  it  very  informative. 
However,  more  time  at  the  terminal  would  have  been  appreciated. 
I realize,  of  course,  the  difficulty  of  dividing  2 terminals 
between  the  amount  of  participants. 


It  would  have  been  more  effective  if  projector  terminals  are 
used . 


Facilities  were  very  good  considering  the  time  span;  however, 
I would  have  liked  to  see  more  access  terminals  during  the 
on-line  sessions.  I was  satisfied  with  the  quality  of  the  online 
sessions,  but  would  have  liked  to  spend  even  more  time.  The 
nessecity  of  having  the  terminals  in  two  locations  did  cause  a 
bit  of  a problem  in  logistics  and  necessitated  the  extending  of 
the  lecture/foil  presentation  brfore  breaking  for  on-line 
training . 


We  would  have  saved  -some  time  if  the  two  modems  and  terminals 
had  been  in  the  same  room  or  close  by.  ('*Get  the  key,  who  has  the 
key,  where  is  the  key,  Frank  has  the  key...''). 


Item  number  9 

More  t ermina 1 s . 


The  limited  number  of  terminals  available  made  it  difficult  to 
allocate  sufficient  time  to  each  student  to  interact  with  the 
system  during  the  online  sessions. 


Item  number  10 

After  reading  the  RECON  user's  manual  and  attending  the 
lectures,  the  hands-on  experience  greatly  enhanced  my 
understanding  of  the  system.  I feel  that  the  lectures  coupled 


-5- 


with  the  hands-on  sessions  are  an  effective  tool. 


1 1 em  number  1 1 

I improved  my  knowledge  of  DBMS/IS&R  systems  from  the  workshop 
activites.  Comparing  the  features  k performance  of  NASA/RECON 
vs.  other  IS&R  systems  I have  used,  I was  able  to  understand  the 
sub j ect  much  more . 
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GENERAL  COMMENTS 


The  workshop  was  excellent.  It  was  really  well  organized  and 
supported,  although  an  extra  terminal  could  be  used  to  a good 
advantage.  I learned  much  more  than  I expected.  Really  a 
professional  event!  The  certificates  were  a nice  idea,  also. 

It  would  be  nice  if  a follow-up  of  implementation  details 
(i.e.  a leaflet,  handout,  book,  etc)  could  be  obtained  by  NASA 
HQ.  about  the  physical  configuration  of  RECON  and  made  available 
to  the  CMPS669  class  so  that  we  all  know  what  we  are  working 
with. 


Very  positive  experience.  Organization,  Presentation  and  Time 
Online  were  all  ''first  class". 

The  few  "technical  questions"  still  unanswered  (restrictions 
on  SORT,  KEEP,  lack  of  consistency  in  mnemonics,  highlighting...) 
are  of  minor  importance. 

The  strong  points  of  NASA/RECON  (FREQUENCY,  KEEP,  SORT(S)) 
were  well  explained  and  exemplified. 

Any  negative  points  would  be  irrelevant  anyway,  since  there 
was  no  time  left  to  include  anything  else  during  these  3 days. 
Thanks,  to  all  concerned. 


The  workshop  gave  me  a much  clearer  understanding  of  the 
database  environment  as  well  as  a deeper  appreciation  of  its 
complexity.  Mr.  Wynne's  and  Eckert's  manner  made  the  lecture 
series  both  informative  and  interesting. 


Having  had  the  opportunity  to  participate  in  the  excellent 
NASA/RECON  Training  workshop  at  the  University  of  Southwestern 
Louisiana,  we  are  now  prepared  to  go  forth  effectively  in  our 
planning  for  implementing  activities  associated  with  achieving 
objectives  of  our  NASA/RECON  contract  as  it  relates  to 
workshops/course  development,  implementation,  evaluation  and 
documentation.  In  addition,  the  research  capabilities  of  the 
Computer  Science  faculty  and  students  at  Southern 
University-Baton  Rouge  have  been  extended  through  our 
participation.  Phil  Eckert,  Hall  Wynne,  and  Wayne  Dominick  are  to 
be  congratulated  for  sponsoring  such  an  excellent  NASA/RECON 
Training  Workshop. 


Overall  — The  workshop  far  exceeded  my  expectations.  Fantastic 
Job  ! ! 


For  me  this  had  been  one  of  the  best  experiences  — for 
hands-on  usage  on  IS&R  systems.  I think  I learned  a lot  during 
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tutorial  sessions. 


The  certificates  of  completion  are  very  nice  and  appropriate. 


I*d  like  to  thank  Mr.  Phil  Eckert  and  Mr.  Hal  Wynne  and  of 
course  Dr.  Wayne  D.  Dominick  for  providing  such  a great 
opportunity  to  participate  in  the  NASA/RECON  Training  Workshop. 

I have  a strong  feeling  that  the  workshop  activities  will 
contribute  significantly  to  my  research  within  the  area  of 
Management  Information  Systems*  part i cular i ly  Information  Storage 
and  Retrieval  Systems. 


I found  it  generally  to  be  very  satisfactory  and  informative. 
I am  thankful  I was  invited  to  participate. 

If  it  is  possible  for  the  next  workshop,  two  (or  more) 
terminals  should  be  located  at  the  same  place  so  that  time  won't 
be  wasted  in  running  back  and  forth  from  one  place  to' another. 
And  get  more  hands-on  experience. 


Sometimes  we  want  to  know  the  physical  structure  (file 
structure,  security  level,  etc)  and  design  criteria  to  evaluate 
the  system  performance.  I expected  you  to  suggest  some 
information  about  Database  design  in  addition  to  the  usage  of  the 
RECON  system. 


I wish  we  had  been  able  to  spend  more  time  on  the  system, 
especially  in  independent  searches.  The  experience  may  have  been 
more  total  if  we  had  had  more  time  to  prepare  ourselves  for  it, 
by  reading  the  handbook,  planning  each  session,  etc. 


It  was  not  clear  the  description  about  the  different  files. 

In  the  workshop,  the  lectures  only  covered  basic  concepts  and 
usage  of  RECON.  The  advanced  topics  were  not  included. 


Being  presently  enrolled  in  the  course  of  Data  Base 
Management,  I feel  that  my  participation  in  the  NASA/RECON 
workshop  has  given  me  a.  .bet  ter.  understanding  of  the  course.  Also, 
I obtained  valuable  knowledge  on  Information  Retrieval  for 
present  and  future  projects. 
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ATTACHMENT  6.3 


USL  COMPUTER  SCIENCE  DEPARTMENT  COURSE 
CMPS669  "ADVANCE  TOPICS  IN  COMPUTER-BASED 

INFORMATION  SYSTEMS  (NASA/RECON)" 
COURSE  SYLLABUS,  SPRING  1984 


I CMPS669  I 


I Sy 1 labus  | 


CMPS  669 


ADVANCED  TOPICS 


IN  COMPUTER-BASED  INFORMATION  SYSTEMS 
( NASA  RECON  ) 


INSTRUCTOR:  Dr.  Wayne  D.  Dominick 

Office:  Stephens,  Room  133 

OBJECTIVES:  To  provide  s t at e— o f — the— ar t knowledge  of,  and 

pragmatic,  hands-on  working  experience  with,  one 
or  more  of  the  largest  and  most  sophisticated 
interactive  information  storage  and  retrieval 
systems  in  existence  and  in  production  use  at  the 
present  time.  Access  to  such  systems  will  be 
provided  pursuant  to  contract  research  to  be 
performed  for  the  National  Aeronautics  and  Space 
Administration  (NASA). 


PREREQUISITES : 


CMPS560  and  Consent  of  Instructor 


SCHEDULING:  To  Be  Determined  Based  on  Participants  Schedules 

COURSE  FORMAT:  Lecture  (1/4) 

Seminar  (3/4) 

Small  study  groups  to  work  on  projects 


REQUIREMENTS: 


% of  grade 


Seminar  participation 
Information  system  usage  tasks 
One  individual  or  group  project 

- Oral  proposal  presentation 

- Oral  final  presentation 

- Written  final  report 


20  % 
30  % 
50  % 
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(TOPICS  TO  BE  ADDRESSED): 


Pursuant  to  the  specifications  of  a research  contract  to  be 
entered  into  in  December,  1983  with  the  National  Aeronautics  and 
Space  Administration  (NASA),  the  Computer  Science  Department  at 
USL  will  be  working  jointly  with  the  Department  of  Computer 
Science  at  Southern  University  to  address  a variety  of  research 
and  educational  issues  relating  to  the  use  of  some  of  the  largest 
interactive  information  storage  and  retrieval  systems  currently 
in  use  at  the  present  time. 


The  specific  systems  to  be  addressed  within  the  scope  of 
this  work  are  projected  to  include  the  following: 

[1]  NASA  / RECON 

[2]  DIALOG 

[3]  DEPARTMENT  OF  ENERGY  / RECON 

[4]  DEPARTMENT  OF  DEFENSE  / DTIC  / DROLS 

[5]  ENVIRONMENTAL  PROTECTION  AGENGY  / CSIN  - Chemical 
Substance  Information  Network 

[6]  LAWRENCE  LIVERMORE  NATIONAL  LABORATORY  / TIS 
Technology  Information  System,  Intelligent  Gateway 
System. 


As  this  is  projected  to  be  a 6— B year  funded  contract, 


IS  to  the  s e 
f rame . However 
be  provided 


systems  will  be  spread  out  over  a several  year 
, during  the  Spring  Semester,  1984,  access 
at  least  to  the  NASA  / RECON  system  for  use 


within  this  offering  of  CMPS669. 


The  overall  orientation  of  the  CMPS669  activities  will  be  to 
address  both  s t a t e— o f —the—ar t aspects  and  pragmatic  usage  aspects 
of  these  systems.  In  particular,  CMPS669  will  provide  the 
framework  for  applying  the  general  concepts  presented  in 
CMPS58X— type  courses  to  one  or  more  of  these  specific  systems. 
Generically,  the  types  of  concepts  to  be  applied  will  include  the 
foil  owing : 


FEATURE  ANALYSIS  OF  INTERACTIVE  INFORMATION  STORAGE  AND 

RETRIEVAL  SYSTEMS 


User  Categorizations 

System  Administrators 

Data  Base  Administrators 

Applications  Programmers 

Information  Specialists 

End  Users 

Parametric  Users 
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Data  Models 

Hierarchical  Data  Model 

Network  Data  Model 

Relational  Data  Model 

Flat  Fi le  Model 

Logical  Data  Structures 

1 1 em  Level 

Group  Level 

Record  Level 

File  Level 

Data  Base  Leve 1 

Phy s ical  Storage  Structures 

Data  Representation  Considerations 

Data  Characteristics  Considerations 

Device  Characteristics  Considerations 

Storage  Structuring  and  Accessing  Techniques 

Data  Base  Definition 

Data  Definition 

Data  Relationships  Definition 

Data  Value  Integrity  Constraints 

Data  Indexing 

Data  Base  Definition  Languages 

Data  Base  Interrogation/Searching 

Basic  ^election  Constructs 

Index  Searching  vs.  Data  File  Searching 

String  Matching  Options 

Existence  Checking 

Compound  Conditions 

Data  Base  Searching  Language  s 

Data  Base  Report  Generation 

Online  vs.  Offline  Report  Generation 

System  Default  Report  Formats 

User-Defined  Report  Formats 

Alternate  Output  Format  s 

Report  Gene  rat  ion  Languages 

Data  Base  Update 

Update  Operations 

Update  Modes 

Update  Data  Formats 

Update  History  Files 

Update  Utilities 

Update  Access  Control 
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Data  Base  Update  Languages 

Data  Base  Redefinition 

Logical  Data  Structure  Redefinition 

Physical  Storage  Structure  Redefinition 

Redefinition  Facilities 

Data  Base  Redefinition  Languages 

Admin i strative  Funct ions 

System  Administrator  Functions 

Data  Base  Administrator  Functions 

Data  Base  Security  Considerations 

Authentication 

Authorization 

Privacy/Security  Transformations 

L Security  Logging 

Performance  Measurement  and  Evaluation 

System  Execution  Efficiency  Orientations 

User  Interface/Interaction  Orientations 

PME  Tools  and  Techniques 

Privacy  Considerations 


BIBLIOGRAPHIC  DATA  BASE  DESIGN 

Bibliographic  Data  Items/Fields 

Bibliographic  Record  Formats 

Document  Files 

Index  Files 

Thesaurus  Files 

Sample  Search  Files 

User  Profile  Files 


BIBLIOGRAPHIC  FILE  STRUCTURES 

Linear  File  Organizations 

List  Structured  File  Organizations 

— r-  Multi-List  Files 

Inverted  Fi les 

Clustered  File  Organizations 

Cluster  Generation 

Cluster  Definition 

Cluster  Searching 
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VOCABULARY  CONTROL 

Controlled  Vocabularies 

Pr e-Cont r o 1 1 ed  Vocabularies 

Post-Controlled  Vocabularies 

Free  Text  Approaches 

Thesaurus  Support 

Broader  Terms 

Narrower  Terms 

Synonyms 

Abbreviations 

Related  Terms 


BIBLIOGRAPHIC  DATA  BASE  SEARCHING 

Types/Levels  of  Search  Languages 

Procedural,  Host— Language— Based  Languages 

Self-Contained.  Structured  Query  Languages 

Procedure  Definition  and  Invocation  Languages 

Interactive,  Prompt ing— Or i ented  Languages 

Batch,  Forms-Or i ent ed  Languages 

Interactive,  Fo rms-Or i ent ed  Languages 

List/lfenu  Selection  Languages 

Restricted  Natural  Languages 

" Unrestricted  Natural  Languages 

Integrated  Combinations  of  the  Above 

Search  Formulation  Features 

Search  Field  Control 

Single  Term  Searching 

Phrase  Searching 

Term  Proximity  Searching 

Term  Range  Searching 

Root  Searching/Suffix  Strip/Prefix  Strip  Searching 

Substring  Searching 

Dictionary  Searching 

Thesaurus  Searching 

Relational  Operation  Usage 

— — Logical  (Boolean)  Operation  Usage 

Request  Sets/Search  Sets 

Search  Profiles/Saved  Search  Strategies 

Search  Review 
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Output  Generation  Features 

Online/Offline  Output  Generation 

. Pre-Defined  Output  Formats 

User-Defined  Output  Formats 

Rapid  Scan 

Expanding 

Hi ghl i ght ing 

Sorting 

Ranking 

Instructi onal/Di agnostic  Features 

Online  System  Documentation 

Online  Data  Base  Documentation 

Online  Training 

Error  Diagnostic  Facilities 

Sample  Searches 

Search  Logic  Tracing 


ADDITIONAL  I S&R  APPLICATION  AREAS 

Selective  Dissemination  of  Information  (SDI)  Systems 

and  Current  Awareness  Systems 
Support  For  Personal  Files 

Interfaces  With  Document  Delivery  Systems 


IS&R  PERFORMANCE  MEASUREMENT  AND  EVALUATION. 

Phases  of  the  PME  Life  Cycle 

Identification  of  Generic  Evaluation  Objectives 

Identification  of  Detailed  Measurement  Parameters 

Selection  of  Measurement  Mechanisms 

Identification  of  Required  Data  Analyses 

Design/Conduct  of  Data  Collection  Experiments 

Conduct  of  Data  Analysis/Evaluation  Activities 

Identification  of  Desired  Improvements/Enhancements 

Implementation  of  Identified  Enhancements 

Repetition  of  Cycle  as  Dictated  by  Objectives 

Traditional,  Obtrusive  User  Monitoring 

Controlled  Usage  Experiments 

Use  of  Human  Subjects 

Subjective  User  Assessments 

Recall  and  Precision  Analysis 

Failure  Analysis 

Data  Base  Coverage  Analysis 
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Advanced,  Unobtrusive  User  Monitoring 

Quasi-Controlled  Usage  Experiments 

Unobtrusive  Software  Monitoring  Facilities 

System  Usage  Profile  and  Data  Base  Usage  Profile 

Ana  lysis 

Timing  Analysis 

User  Error  and  Error  Recovery  Analysis 

Direct  and  Surrogate  Measures  of  User  Success 

Automated  Statistical  Data  Analysis 

Trend  Analysis/Projection  Analysis 


FUTURE  INFORMATION  STORAGE  AND  RETRIEVAL  SYSTEMS 

Assessment  of  Current  S t at e-o f-the-Ar t 

Identification  of  Current  Research  Trends 

V Projection  of  Future  System  Capabilities 


REQUIRED  READINGS: 


[1]  The  NASA  Contract  Research  Sc  Development  Proposal  and  all 
subsequent  reports  prepared  pursuant  to  that  proposal. 

[8]  System  and  data  base  documentation  associated  with  the 
specific  information  systems  that  will  be  addressed  within 
the  scope  of  the  course.  At  a minimum, .. thi s will  include  all 
documentation  associated  with  the  NASA  RECON  system.  In 
general,  such  documentation  would  include: 

[a]  System  users  manuals 

[b]  System  update  bulletins 

[c]  Data  base  guides 

[d]  Data  base  thes aur i 

[e]  Data  base  update  bulletins. 


OTHER  REFERENCES: 


[1]  Selected  articles  addressing  s t a t e— o f — the— ar t reviews  of  the 
aforementioned  information  systems. 

[2]  Other  system . and/or  data  base  reference  material  that  may  be 
provided  by  the  funding  agency  for  this  work. 
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USL  CMPS669  STUDENT  TASKS/ ASSIGNMENTS 
TASKING  SPECIFICATIONS  DOCUMENT: 
SPRING  SEMESTER,  1984 
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CMPS  669  - STUDENT  TASKS  / ASSIGNMENTS 


(1)  NASA/CMPS669  LIBRARY. 

(a)  Identify  relevant  IS&R  s t a t e— o f — t he— ar t reading 

material  and  reference  material,  e.g.,  journal 

articles,  books,  government  reports.  etc.  [LiuIH  & 
PenaCA;  GranierMR  (Government  Documents  Only)] 

(b)  Definition,  population,  and  maintenance  of  a MADAM  data 
base  of  all  such  - reading  material  and  reference 
material.  [LiuIH  &c  PenaCA] 

(2)  DBMS .NASA/RECON  WORKING  PAPER  SERIES. 

(a)  Identification  of  potential  topics  for  inclusion  within 
the  DBMS  NASA/RECON  Working  Paper  Series.  [ANY 
PARTICIPANT] 

(b)  Contribution  of  potential  entries  for  this  Working 
Paper  Series  based  on  CMPS669  course  work  performed. 
[ANY  PARTICIPANT] 

(c)  For  each  potential  entry  submitted  by  a CMPS869 
student,  two  other  CMPS669  students  will  serve  as  the 
reviewers  for  the  entry  to  ensure  that  all  student 
submissions  are  subjected  to  a peer  review  process. 
[ALL  PARTICIPANTS  WILL  SERVE  AS  REVIEWERS] 

(3)  CONTRACT  NEEDS  ANALYSIS  PHASE. 

(a)  Attend/participate  in  NASA/RECON  workshop,  assuming 
that  WDD  can  get  this  workshop  scheduled  locally 
(either  at  USL  or  at  SU) . [COMPLETED  AT  USL: 

. 01/31/84-02/02/84] 

(b)  Assist  in  identifying  target  institutions  for  the  needs 
analysis  questionnaire  distribution.  [DominickWD  & 
ChumFY  & Tr i ant  a f y 1 I opou I o sS ] 
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(c) 


Assist  in  developing  the  needs  ana 
[INPUT:  ALL  PARTICIPANTS;  FINAL 
Grani erMR] 


lysis  questionnaire. 
IZATION:  KnellerMS  & 


(d)  Survey  targeted 
RoquemoreL] 


institutions. 


[DominickWD  & 


(e)  Analysis  of  questionnaire  results.  (Should  not  require 
more  than  1—2  students  over  a period  of  1—2  weeks.) 
[GallagherMC  & KaviS] 


(f)  Evaluation  of  phase  activities.  [DominickVD  & 
RoquemoreL  k RAs] 


(g)  Interim  Report  No.  1.  [DominickWD  & RoquemoreL] 


(4)  NASA  RECON  SYSTEM  USAGE. 


(a)  Extent  of  actual  hands-on  usage  by  CMPS669  students 

will  depend  heavily  on  on-line  system  connect 

time/telephone  line  charges  and  budget  constraints. 

(b)  At  a minimum,  students  will  at  least  make 

recommendations  for  content  of  course  usage 
as s i gnment  s . 

(c)  May  have  only  selected  students  actually  performing  the 
on-line  interactive  sessions. 


(5)  NASA  CONTRACT  EQUIPMENT  SELECTION. 

(a)  Terminals  versus  PC-based  workstations.  [INPUT:  ALL 

KNOWLEDGEABLE  PARTICIPANTS;  FINAL  RECOMMENDATIONS; 
Triantafyl lopoulosS  k ChumFY] 
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(6)  COURSE  VISUALS  DEVELOPMENT. 

Topic  areas  will  cover  all  of  the  areas  identified  within 
the  CMPS669  syllabus.  Students  will  propose/select  specific 
topic  area(s)  and  proceed  to  develop  associated  topic 
visuals.  This  task  will  represent  a major  portion  of  the 
student  work  within  CMPS669 . Topic  areas  will  include.  but 
not  necessarily  be  limited  to  the  foil ow i ng : 

FEATURE  ANALYSIS  OF  INTERACTIVE  INFORMATION  STORAGE  AND 

RETRIEVAL  SYSTEMS 

User  Categorizations  [HallPP]  • 

System  Administrators 

Data  Base  Administrators 

App lications  Programmers 

Inf  or mat  ion  Specialists 

End  Users 

Parametric  Users 

Data  Models  [SriAR] 

Hierarchical  Data  Model  • 

Network  Data  Model 

Re  1 at i ona 1 Data  Model 

Flat  File  Model 

Logical  Data  Structures  [NamK] 

1 1 em  Leve 1 

Group  Leve 1 

Record  Leve 1 

File  Level 

Data  Base  Level 


Physical  Storage  Structures  [NamK] 

Data  Representation  Considerations 

— ^ Data  Characteristics  Considerations 

Device  Charac  t eristics  Considerations 

Storage  Structuring  and  Accessing  Techniques 


Data 


Base  Definition  [ E IMougy SA ] 

Data  Definiti on 
Data  Relationships  Definition 
Data  Value  Integrity  Constraints 
Data  Indexing 

Data  Base  Definition  Languages 
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Data  Base  Interrogation/Searching  [GranierMR] 

Basic  Selection  Constructs 

Index  Searching  vs.  Data  File  Searching 

String  Matching  Options 

Existence  Checking 

Compound  Conditions 

Data  Base  Searching  Languages 

Data  Base  Report  Generation  [SriAR] 

Online  vs.  Offline  Report  Generation 

System  Default  Report  Formats 

User— Defined  Report  Formats 

Alternate  Output  Formats 

Report  Generation  Languages 

Data  Base  Update  [ElMougySA] 

Update  Operations 

Update  Modes 

Update  Data  Formats 

Update  History  Files 

Update  Utilities 

Update  Access  Control 

Data  Base  Update  Languages 

Data  Base  Redefinition  [ElMougySA] 

Logical  Data  Structure  Redefinition 

Physical  Storage  Structure  Redefinition 

Redefinition  Facilities 

Data  Base  Redefinition  Languages 

Administrative  Func t ions  [ElMougySA] 

System  Administrator  Functions 

Data  Base  Administrator  Functions 

Data  Base  Security  Considerations  [YuWC] 

Authentication 

Authorization 

Privacy/Security  Transformations 

Security  Logging 

Performance  Measurement  and  Evaluation  [KaviS] 

System  Execution  Efficiency  Orientations 

User  I nt e r f ac e/ Int e r ac t i on  Orientations 

PME  Tools  and  Techniques 

Privacy  Considerations 
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BIBLIOGRAPHIC  DATA  BASE  DESIGN  [NamK] 

Bibliographic  Data  Items/Fields 

Bibliographic  Record  Formats 

Document  Files 

Index  Files 

Thesaurus  Files 

Sample  Search  Files 

User  Profile  Files 

o 1 ui-i  1 uvrivArn  1 u riLii  o i i unn o [namnj 

Linear  File  Organizations 

List  Structured  File  Organizations 

Multi-List  Files 

Inverted  Files 

Clustered  File  Organizations 

Cluster  Generation 

Cluster  Definition 

Cluster  Searching 

VOCABULARY  CONTROL  [ Ga 1 1 aghe rMC ] 

Controlled  Vocabularies 

Pr e-Cont r o 1 1 ed  Vocabularies 

Post-Controlled  Vocabularies 

Free  Text  Approaches 

Thesaurus  Support 

Broader  Terms 

Narrower  Terms 

Synonyms 

Abbreviations 

Related  Terms 

BIBLIOGRAPHIC  DATA  BASE  SEARCHING 

Types/Levels  of  Search  Languages  [SriAR  & LiuIH] 

Procedural , Host-Language-Based  Languages 

Self-Contained,  Structured  Query  Languages 

Procedure  Definition  and  Invocation  Languages 

Interactive,  Prompting-Oriented  Languages 
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Batch,  Forms-Or i ent ed  Languages 

Interactive,  Fo rms— Or i ent ed  Languages 

List/Menu  Selection  Languages 

Restricted  Natural  Languages 

Unrestricted  Natural  Languages 

Integrated  Combinations  of  the  Above 

Search  Formulation  Features  [GranierMR  8c 
Gall agherMC ] 

Search  Field  Control 

Single  Term  Searching 

Phrase  Searching 

Term  Proximity  Searching 

Term  Range  Searching 

Root  Searching/Suffix  Strip/Prefix  Strip 

Searching 

Substring  Searching 

Dictionary  Searching 

Thesaurus  Searching 

Relational  Operation  Usage 

Logical  (Boolean)  Operation  Usage 

Request  Sets/Search  Sets 

Search  Profiles/Saved  Search  Strategies 

Search  Review 

Output  Generation  Features  [SriAR] 

Online/Offline  Output  Generation 

Pre— Defined  Output  Formats 

User— Defined  Output  Formats 

Rapi d Scan 

Expanding 

Highl ight ing 

Sorting 

Ranking 

..Instruct  ional/Di  agnost  ic  Features  [KaviS] 

Online  System  Documentation 

Online  Data  Base  Documentation 

Online  Training 

Error  Diagnostic  Facilities 

Sample  Searches 

Search  Logic  Tracing 
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ADDITIONAL  I S&R  APPLICATION  AREAS  [ElMougySA] 

Selective  Dissemination  of  Information  (SDI) 

Systems  and  Current  Awareness  Systems 
Support  For  Personal  Files 

Interfaces  With  Document  Delivery  Systems 

IS&R  PERFORMANCE  MEASUREMENT  AND  EVALUATION 

Phases  of  the  PME  Life  Cycle  [KaviS] 

Identification  of  Generic  Evaluation 

Objectives 

Identification  of  Detailed  Measurement 

Par ame t er s 

Selection  of  Measurement  Mechanisms 

Identification  of  Required  Data  Analyses 

Design/Conduct  of  Data  Collection  Experiments 

Conduct  of  Data  Analysis  / Evaluation 

Activities 

Identification  of  Desired  Improvements  / 

Enhancement  s 

Imp lementation  of  Identified  Enhancements 

Repetition  of  Cycle  as  Dictated  by  Objectives 

Traditional,  Obtrusive  User  Monitoring  [HallPP] 

Controlled  Usage  Experiments 

Use  of  Human  Subjects 

Subjective  User  Assessments 

Reca 1 1 and  Precision  Ana  lysis 

Failure  Analysis 

Data  Base  Coverage  Ana  lysis 

Advanced,  Unobtrusive  User  Monitoring  [HallPP] 

Quasi-Controlled  Usage  Experiments 

Unobt  rus ive  Software  Mon itoring  Facilities 

— “ System  Usage  Profile  and  Data  Base  Usage 
Profile  Ana  lysis 
Timing  Analysis 

User  Error  and  Error  Recovery  Analysis 

— ^ D i r e c t and ' Sur r oga t e Measur e s of  User  Success 

Automated  Statistical  Data  Ana  lysis 

Trend  Analysis/Projection  Analysis 
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FUTURE  INFORMATION  STORAGE  AND  RETRIEVAL  SYSTEMS 

[ALL  PARTICIPANTS  WILL  CONTRIBUTE  BASED  UPON 
FUTURES-ORIENTED  ASPECTS  WITHIN  THEIR  INDIVIDUAL 
TOPICAL  AREAS] 

Assessment  of  Current  S t at e-o f-the-Ar t 

Identification  of  Current  Research  Trends 

Projection  of  Future  System  Capabilities 

Additionally,  visuals  will  be  developed  to  illustrate 
NASA/RECON  examples  addressing  selected  topics  from  the 
above  list. 


(7)  OTHER  COURSE  DEVELOPMENT  DELIVERABLES. 

Selected  students  will  participate  in  the  development  of  the 
other  required  course  development  deliverables.  These 
include  the  following: 

(a)  Course  Lesson  Plans.  [KnellerMS  & JohnsonA] 

(b)  RECON  Homework  Assignments  and  Answer:  Keys.  [JohnsonA] 

(o)  RECON  Usage  Assignments  and  Answer  Keys.  [HallPP  & 

J ohnsonA] 

(d)  Course  Ezaminat i on( s ) and  Answer  Keys.  [HallPP  & 

J ohnsonA] 


(8)  RESEARCH-ORIENTED  TOPICS:  MS  & PHD  LEVELS. 

(a)  Identification  of  research-oriented  topics,  including 
both  topics  directly  relevant  to  the  existing  contract 
work  and  topics  representing  spin-offs  of  the  existing 
contract  work.  [ANY  PARTICIPANT] 

MS  Theses  and  Projects  currently  in  progress  within 
this  context  include  the  following: 

(al)  "Critical  Comparative  Analysis  of  the  Major 
Commercial  I S&R  Systems",  MS  Thesis.  [GranierMR] 
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(a2)  “Knowledge  Based  Systems:  A Critical  Survey  of 

Major  Issues  and  Techniques".  MS  Thesis.  [KaviS] 

(a3)  “Natural  Language  Query  System  Design",  MS 

Project.  [ L iuIH] 

(a4)  “A  Thesaurus  Sub-System  for  the  MADAM  Information 
Storage  and  Retrieval  System",  MS  Project. 

[Gal lagherMC] 

(a5)  "Performance  Overhead  Cost  Measurement  and 
Prediction  for  Information  Systems",  MS  Project. 
[YuWC] 

(b)  Assist  in  proposal  preparation  directed  at  securing 
outside  funding  for  the  conduct  of  such  research 
topics.  [ANY  PARTICIPANT;  TASKING  WILL  BE  AS  NEEDED] 

(9)  LONG-RANGE  PLAN  DEVELOPMENT. 

Each  student  will  be  expect  ed  to  provide  i nput  into  the 
development  of  a long-range  plan  f or^:^conduct  ing  continued 
follow-on  work  after  the  termination  of  CMPS669  this 
semester.  Note  that  this  will  not  require  any  student 
commitment  to  participate  in  these  follow— on  activities, 
merely  to  assist  in  identifying  the  follow— on  activities. 
Examples  of  follow-on  activities  would  include  items  such  as 
the  following:  [ALL  PARTICIPANTS] 

(a)  Should  there  be  a follow-on  CMPS669  offered  after  the 
completion  of  this  CMPS669,  e.g.,  in  the  Summer,  1984? 
in  the  Fall,  1984? 

(b)  Plan  for  the  completion  of  MS  and  PhD  research  topics 
as  referenced  in  (8)  above. 

(c)  Plan  for  student  participation  in  follow-on  contracts. 
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(10)  OTHER  CONTRACT  RELATED  TASKS. 

(a)  Coordination  of  needs  analysis  questionnaire  results, 

course  syllabi,  lesson  plans,  and  visuals:  [KnellerMS] 

Identification  of  questionnaire  respondents  and 

coordination  with  questionnaire  items. 

Coordination  of  questi onna ire  results  with  course 

syllabi. 

Coordination  of  questionnaire  results  with  lesson 

plan  format . 

Development  of  format  for  lesson  plans. 

Development  of  lesson  plan  standardization 
requi rements . 

Development  of  lesson  plan  "levels  of  difficulty" 

rat ings . 

Compilation  and  coordination  of  lesson  plans  into 

packe  t s . 

Coordination  of  lesson  plans  with  visuals/handouts 

developed  by  other  partic ip ant  s . 

(b)  Development  of  user/system  interface  for  PC  equipment 
to  be  util  ized  within  the  contract;::  wark:.'[  Hal  IPP] 

(c)  Development  of  an  evaluation  methodology  for 

determining  the  desirability  of  different  course 
conf i gurat i ons  and  different  PC  interface 

configurations.  [Ha  1 IPP] 

(d)  Specification,  design,  implementation,  testing,  and 
operational  use  of  a NASA  Multics  Workbench  to  support 
management  control  over,  and  user  access  to  all  Multics 
facilities  to  be  utilized  in  support  of  the  contract 
work . [Marmar itsakisS] 

(e)  Specification,  - design,  implementation,  testing,  and 
operational  use  of  a PC— based  simulator  of  the 
NAS A/RE CON  system.  [PenaCA ] 
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( 4 ) NASA  RECX)N  SYSTEM  USAGE  . 

(a)  Extent  of  actual  hands-on  usage  by  CMPS669  students 

will  depend  heavily  on  on-line  system  connect 

t ime / t e 1 e phone  line  charges  and  budget  constraints. 

(b)  At  a minimum,  students  will  at  least  make 

r e c oirmenda  t i on  s for  content  of  course  usage 

a s s i gnment  s • 

(c)  May  have  only  selected  students  actually  performing  the 
on-line  interactive  sessions. 


(5)  CXDURSE  VISUALS  DEVELOPMENT. 

[TEAM  LEADER:  GallagherMC; 

TEAM  MEMBERS  : LiulH,  SriAR,  Bassarij(  support)] 


Topic  areas  will  cover  all  of  the  areas  . identified  within 
the  CMPS669  syllabus.  Activities  will  focus  on  reviewing, 
revising,  and  coordinating  first  draft  visuals  developed 
during  the  Spring  Semester  CMPS669.  Topic  areas  will 
include,  but  not  necessarily  be  limited  to  the  following: 


FEATURE  ANALYSIS  OF  INTERACTIVE  INFORMATION  STORAGE  AND 

RETRIEVAL  SYSTEMS 


User  Categorizations 

System  Administrators 

Data  Base  Administrators 

Ap plications  Progr aorme r s 

Information  Specialists 

End  Users 

Parametric  Users 


Data  Mode  1 s 

Hierarchical  Data  Model 

Network  Data  Model 

Relational  Data  Model 

Flat  File  Mode  1 


Logical  Data  Structures 

1 1 em  Le  ve  1 

Group  Level 

Record  Level 


I T A S K S I 


2 


I ASSIGNMENTS  I 


I CMPS669  I 


O:  01/16/84 
R:  06/05/84 


File  Level 

Da ta  Base  Level 

Physical  Storage  Structures 

Data  Representation  Considerations 

Data  Characteristics  Considerations 

Device  Characteristics  Considerations 

Storage  Structuring  and  Accessing  Techniques 

Da  t a Ba  s e De  f i n i t i on 

Data  Definition 

Data  Relationships  Definition 

Data  Value  Integrity  Constraints 

Data  Indexing 

Data  Base  Definition  Languages 

Data  Base  Interrogation/Searching 

Basic  Selection  Constructs 

Index  Searching  vs.  Data  File  Searching 

String  Matching  Options 

Ex i s t enc e Che  eking 

Compound  Conditions 

Data  Base  Searching  Languages 

Data  Base  Report  Generation 

Online  vs.  Offline  Report  Generation 

System  Default  Report  Formats 

User-Defined  Report  Formats 

Alternate  Output  Formats 

Report  Gene  r a t i on  Language  s 

Data  Base  Update 

Update  Operations 

Update  Modes 

Update  Data  Formats 

Update  History  Files 

Update  Utilities 

Update  Access  Control 

Data  Base  Update  Languages 

Da  ta  Base  Redefinition 

Log i ca 1 Da  ta  Structure  Redefinition 

Physical  Storage  Structure  Redefinition 

Redefinition  Facilities 

Data  Base  Redefinition  Languages 
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Admi nistrative  Functions 

Sy s t em  Admi ni s t r a t or  Functions 

Data  Base  Administrator  Functions 

Data  Base  Security  Considerations 

Authent i cat i on 

Author i za  t i on 

Privacy/Security  Transformations 

Security  Logging 

Performance  Measurement  and  Evaluation 

System  Execution  Efficiency  Orientations 

User  I n t e r f a c e / I n t e r a c t i on  Orientations 

PME  Tools  and  Techniques 

Privacy  Considerations 

BIBLIOGRAPHIC  DATA  BASE  DESIGN 

Bibliographic  Data  Items/Fields 

Bibliographic  Record  Format  s 

Do  c ume  n t Files 

Index  Files 

The  saurus  Files 

S amp le  Search  Files 

User  Profile  Files 

BIBLIOGRAPHIC  FILE  STRUCTURES 

Linear  File  Organizations 

List  Structured  File  Or g an i za t i ons 

Multi-List  Files 

Invert  ed  Files 

Clustered  File  Or gan i za t i ons 

Cluster  General  ion 

Cluster  Def ini t ion 

Cluster  Searching 

VOCABULARY  CONTROL 

Controlled  Vocabularies 

Pr e-Cont r o 1 1 ed  Vocabularies 

Post-Controlled  Vocabularies 
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Free  Text  Approaches 

Thesaurus  Support 

Broader  Terms 

Narrower  Terms 

Synonyms 

Abbreviations 

Related  Terms 

BIBLIOGRAPHIC  DATA  BASE  SEARCHING 

Types/Levels  of  Search  Languages 

Procedural,  Host-Language-Based  Languages 

Self-Contained,  Structured  Query  Languages 

Procedure  Definition  and  Invocation  Languages 

Interactive,  Prompting-Oriented  Languages 

Batch,  Forms-Or i ented  Languages 

Interactive,  Forms-Or i ented  Languages 

List/Menu  Selection  Languages 

Restricted  Natural  Languages 

Unrestricted  Natural  Languages 

Integrated  Combinations  of  the  Above 

Search  Formulation  Features 

Search  Field  Control 

Single  Term  Searching 

Phrase  Searching 

Term  Proximity  Searching 

Term  Range  Searching 

Root  Searching/Suffix  Strip/Prefix  Strip 

Searching 

Substring  Searching 

Dictionary  Searching 

Thesaurus  Searching 

Relational  Operation  Usage 

Logical  (Boolean)  Operation  Usage 

Request  Sets/Search  Sets 

Search  Prof i 1 e s /Saved  Search  Strategies 

Search  Review 
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Output  Generation  Features 

Online/Offline  Output  Generation 

Pre-Defincd  Output  Formats 

User-Defined  Output  Formats 

Rapid  Scan 

Expanding 

Highlighting 

Sorting 

Ranking 

Ins  true t i ona 1/Di agnos t i c Features 

Online  System  Documentation 

Online  Data  Base  Documentation 

Online  Training 

Error  Diagnostic  Facilities 

Sample  Searches 

Search  Logic  Tracing 

ADDITIONAL  IS&R  APPLICATION  AREAS 

Selective  Dissemination  of  Information  (SDI) 

Systems  and  Current  Awareness  Systems 
Support  For  Personal  Files 

Interfaces  With  Document  Delivery  Systems 

IS&R  PERFORMANCE  MEASUREMENT  AND  EVALUATION 

Phases  of  the  FME  Life  Cycle 

Identification  of  Generic  Evaluation 

Object ives 

Identification  of  Detailed  Measurement 

Parameters 

Selection  of  Measurement  Mechanisms 

Identification  of  Required  Data  Analyses 

Design/Conduct  of  Data  Collection  Experiments 

Conduct  of  Data  Analysis  / Evaluation 

Ac  tivities 

Identification  of  Desired  Improvements  / 

Enhancements 

Implementation  of  Identified  Enhancements 

Repetition  of  Cycle  as  Dictated  by  Objectives 

Traditional,  Obtrusive  User  Monitoring 

Controlled  Usage  Experiments 

Use  of  Human  Subjects 
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Subjective  User  Assessments 

Recall  and  Precision  Analysis 

Failure  Analysis 

Data  Base  Coverage  Analysis 


Advanced,  Unobtrusi 

Quas i-Cont ro 1 1 

Unobtrusive  So 

System  Usage  P 

Profile  Ana lys 

Timing  Analysi 

User  Error  and 

Direct  and  Sur 

Au  t oma  ted  S t a t 

Trend  Analysis 


ve  User  Monitoring 
ed  Usage  Experiments 
ftware  Monitoring  Facilities 
rofile  and  Data  Base  Usage 
i s 
s 

Error  Recovery  Analysis 
r o g a t e Me  asures  of  User  Success 
istical  Data  Analysis 
/Projection  Analysis 


FUTURE  INFORMATION  STORAGE  AND  RETRIEVAL  SYSTElVlS 

[ALL  PARTICIPANTS  WILL  CONTRIBUTE  BASED  UPON 
FUTURES-ORIENTED  ASPECTS  WITHIN  THEIR  INDIVIDUAL 
TOPICAL  AREAS] 

Assessment  of  Current  State-of-the-Art 

Identification  of  Current  Research  Trends 

Projection  of  Future  Sy s t em  Capab i 1 i t i e s 

Additionally,  visuals  will  be  developed  to  illustrate 
NASA/RECON  examples  addressing  selected  topics  from  the 
above  list. 


(6)  OTHER  COURSE  DEVELOPMENT  DELIVERABLES. 

[TEAM  LEADER:  GranierMR; 

INTERIM  TEAM  LEADER:  GallagherMC; 

TEAM  MEMBERS : NamK,  KnellerMS,  ElMougySA, 

NgSK( support ) ] 

Selected  students  will  participate  in  the  development  and/or 
refinement  of  the  other  required  course  development 

deliverables  based  on  first  drafts  developed  during  the 
Spring  Semester  (MPS669. 

(a)  Course  Lesson  Plans . [Kne 1 lerMS] 

(b)  RECON  Homework  Assignments  and  Answer  Keys.  [NamK] 
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(c)  RECX)N  Usage  Assignments  and  Answer  Keys.[NamK] 

(d)  Course  Exami  na  t i on(  s ) and  Answer  Keys.  [HallPP] 

(e)  Develop  Instructor’s  Manual  and  explanatory  materials 

for  each  course  s ub- s e c t i on . [ E IMougySA , detailed  to 

Gall  aghe  rMC] 

(f)  Coordination  of  needs  analysis  questionnaire  results, 

course  syllabi,  lesson  plans,  and  v i s ua 1 s : [Kne 1 1 e rMS ] 

Identification  of  questionnaire  respondents  and 

coordination  with  questionnaire  items. 

Coordination  of  questionnaire  results  with  course 

syllabi. 

Coordination  of  questionnaire  results  with  lesson 

plan  f o rma  t . 

Development  of  format  for  lesson  plans. 

Development  of  lesson  plan  standardization 
r equ i r ement  s . 

Development  of  lesson  plan  ^levels  of  difficulty” 

ratings . 

Compilation  and  coordination  of  lesson  plans  into 

packets. 

Coordination  of  lesson  plans  with  visuals/handouts 

developed  by  other  participants. 

(7)  RESEARCH-ORIENTED  TOPICS:  MS  & PHD  LEVELS. 

(a)  Identification  of  research-oriented  topics, 
including  both  topics  directly  relevant  to  the 
existing  contract  work  and  topics  representing 
spin-offs  of  the  existing  contract  work.  [ANY 
PARTICIPANT] 

MS  Theses  and  Projects  currently  in  progress 
within  this  context  include  the  following: 

(al)  ^Critical  Comparative  Analysis  of  the  Major 
Conmercial  IS&R  Systems”,  MS  Thesis.  [GranierMR] 

(a2)  ”Knowledge  Based  Systems:  A Critical  Survey  of 

Major  Issues  and  Techniques”,  MS  Thesis.  [KaviS] 
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(a3)  "Natural  Language  Query  System  Design”,  MS  Thesis. 
[LiuIH] 

(a4)  ”An  Innovative,  Multidisciplinary  Educational 
Program  in  Interactive  Information  Storage  and 
Retrieval  Systems”,  MS  Thesis.  [Ga 1 1 agherMC] 

( a5 ) "Performance  Overhead  Cost  Measurement  and 
Prediction  for  Information  Systems”,  MS  Project. 
[YuWC]  (?) 

(b)  Assist  in  proposal  preparation  directed  at  securing 
outside  funding  for  the  conduct  of  such  research 
topics.  [any  PARTICIPANT;  TASKING  WILL  BE  AS  NEEDED] 

(8)  LONG-RANGE  PLAN  DEVELOPMENT. 

Each  student  will  be  expected  to  provide  input  into  the 
development  of  a long-range  plan  for  conducting  continued 
follow-on  work  after  the  termination  of  CMPS669  this 
semester.  Note  that  this  will  not  require  any  student 
conxnitment  to  participate  in  these  follow-on  activities, 
me  rely  to  assist  in  identifying  the  foil ow- on  activities. 
Examples  of  follow-on  activities  would  include  items  such  as 
the  following:  [ALL  PARTICIPANTS] 

(a)  Should  there  be  a follow-on  CMPS669  offered  after  the 
completion  of  this  CMPS669,  e.g.,  in  the  Fall,  1984? 

(b)  Plan  for  the  completion  of  MS  and  PhD  research  topics 
as  referenced  in  (7)  above. 

(c)  Plan  for  student  participation  in  follow-on  contracts. 

(9)  PC-BASED  RESEARCH  & DEVELOHsdENT. 

[TEAM  LEADERS:  HallPP  & Tr i ant af y 1 1 opou 1 o sS  & MoreauDR; 
TEAM  MEMBERS:  YanL,  ChumFY,  TangKS( support ) ] 

(a)  Preparation  of  System  Development  Standards  for  systems 
design,  progranming , testing,  and  documentation  for  use 
within  a C progranming  environment  on  the  IBM  PC/XT’s. 


I TASKS  I 


9 


I ASSIGNVIENTS  I 


I CMPS669  I 


I NASA  I 


O:  01/16/84 
R:  06/05/84 


(b)  Development  of  user/ system  interface  for  PC  equipment 
to  be  utilized  within  the  contract  work. 

(c)  Development  of  an  evaluation  methodology  for 

determining  the  desirability  of  different  course 

configurations  and  different  PC  interface 

conf igurat ions  . 

(d)  Specification,  design,  implementation,  testing,  and 

operational  use  of  a PC— based  simulator  of  the 

NASA/ RECON  system. 

(10)  MULTICS -BASED  RESEARCH  & DEVELOPMENT. 

(a)  Enhancements  to  the  specification,  design, 

implementation,  testing,  and  operational  use  of  a NASA 
Multics  Workbench  to  support  management  control  over, 
and  user  access  to  all  Multics  facilities  to  be 

utilized  in  support  of  the  contract  work . [PenaCA] 

(11)  PREPARATION  OF  FOLLCW-UP  CONTRACT  PROPOSALS. 

[team  LEADERS:  ChumFY  & KaviS  & MoreauDR; 

TEIAM  MEMBERS  : TangKS(  support  ) ] 

(a)  Develop  PC  Simulator  Contract  Proposal  Targeted  to  Jack 
Kolb,  DoD.  [TriantafyllopoulosS] 


(b) 

De ve lop 

Con t rac  t 

Proposal  to 

Incorporate 

Addi t i ona 1 

Sy  s t ems 

into 

the  Contract  Work: 

DOE/RECON. 

[ Ga  1 1 a g h e rMC  ] 

(c) 

Deve 1 op 

Cont  rac  t 

Proposal  to 

Incorporate 

Addi t ional 

Sy  s t ems 

into  the 

Contract  Work: 

DOD/DROLS  . 

[NamK] 

(d) 

Deve 1 op 

Contract 

Proposal  to 

Incorporate 

Addi t i ona 1 

Sy  s t ems 

into  the 

Contract  Work: 

DIALOG.  [Grani erMR] 

(e) 

Deve lop 

Contract 

Proposal  to 

Incorporate 

Add i t i ona I 

Sy  s t ems 

into  the 

Contract  Work: 

SDC. 

(f ) 

Deve lop 

Cont rac  t 

Proposal  to 

Incorporate 

Addi t ional 

Sy  s t ems 

into  the 

Contract  Work: 

BRS. 

(g) 

Deve lop 

Cont  ra  c t 

Proposal  to 

Incorporate 

Add i t i ona 1 

Sy  s t ems 

into  the 

Contract  Work: 

EPA/CSIN.  [HallPP] 
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(h)  Develop  Contract  Proposal  to  Incorporate  Additional 
Systems  into  the  Contract  Work:  LLL/TIS/IGS.  [ChumFY] 
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MULTICS  DIRECTORY  STURCTURE 


USL  D0vC  R&D  PROJECT:  imVRBQCN  MXTICS  DIRBCICRY  STRUCTURE 


> udd  >DHvB  >N'\SAyRBOCN 


quota  = 

1400;  used  = 841 

quota 

used 

di rectory  name 

0 

131 

NASAM&iA.  r&d 

0 

9 

N\SA.me  e t i ng_jio  t e s 

0 

12 

N\SA.  RAjue  e t i ng_no  t e s 

0 

54 

N^SA.  admi  ni  s t ra  t i on 

0 

13 

NASA. pub 1 i cat  ions 

0 

119 

NASA.working_paper_se  r i es 

0 

4 

NASA.Gv1PS669  . s tudent_t asks 

0 

12 

NASA.  backup_tapes 

0 

358 

NASA.  1 as  e reformats 

0 

236 

NASA.mul  t i cs_iVDrkbench 

0 

86 

NASA,  ques  t ionnai  re 

0 

83 

NASA.  course_del  iverabl  es 

0 

43 

NASA. proposals 

0 

8 

NASA.PC.r&d 

0 

1168 

Total 

Segs=0;Msf  s=0;Di  rs=14;Links 

=0. 

>udd>D0v1S>N'^SA/RBCn4>N'^SA.M^D^M.  r&d 

quota  = 

0;  used  = 131 

quota 

used 

directory  name 

0 

12 

OevE  .N'itSA/RBCa4.\M>!M 

0 

3 

DHvB  .Nf\SA/RBXN.  d i 1 .MyMvl 

0 

10 

Oev«  .N/^SA/RBOGN.  t i 1 .MVEViM 

0 

3 

D0vC  .ht\SA/RECCN.  ccm-MVEiaM 

0 

4 

De^  .hASA/RBCCN.  bul  JvMVM 

0 

3 

DHvlS  .NASA/RBCCN.mac 

0 

35  ( 

Total 

Segments 

= 4,  Lengths  = 96. 

rew  17 

N^SA.NMMvLinput . 

Hv€.  input 

P 


1 


rew 

47 

NASA nput . IS&R.  input 
i 

NASA .^^MMvl^i nput . archive 

rew 

23 

p. archive 

rew 

9 

NASA .N'iAEMvLi nput  .RBGCN.  archive 
r .archive 

Mil  t i 

segment-files  = 6,  Lengths  = 59. 

r w 

7 

DBvE  .NASA/RBOOI.mac 

r w 

8 

DevC.N<^SA/RBa3SI.bul 

r w 

7 

DBVB  .N'^WREOCN.  c on.M^ElflM 

r w 

14 

D0^  .N'^SA/RBCEN.  t i 1 .JvMMvl 

r w 

7 

DHvE  .N^VRBCTN,  d i 1 

r w 

16 

DHvB  .N'^SA/RBOCN.NWIl^M 

> udd  >D0vB  >N<\SA/RBIQ^>N^SA.M\Ei^.  r&d>N\SA.M^IMvl_i  nput . RVE.  archive 


name  updated  mode  modified  length 


PER 

04/23/84 

0731.4 

r 

w 

04/21/84 

0445.5 

176283 

P 

04/23/84 

0731.4 

r 

w 

04/22/84 

0242.3 

269235 

G 

04/23/84 

0731.4 

r 

w 

04/22/84 

0306.7 

15003 

V 

04/23/84 

0731.4 

r 

w 

.04/23/84 

0725.0 

272907 

B 

04/23/84 

0731.4 

r 

w 

04/23/84 

0710.5 

10368 

title 

04/29/84 

1436.6 

r 

w 

04/29/84 

0452 . 3 

94212 

> udd  >D0^  >NASA/RBO>I>NASA.NM>^. 

r&d> NASA .MAEVM_i  nput . 

RBOCN.  archive 

name 

updated 

mode 

mod if ied 

length 

inp.  1 

01/17/84 

1106.3 

rew 

01/17/84 

1106.3 

11313 

inp.2 

01/17/84 

1409..1 

rew 

01/17/84 

1409.1 

7587 

inp. 3 

01/17/84 

1410.7 

r w 

01/17/84 

1410.7 

6624 

inp.  4 

01/17/84 

1117.4 

r w 

01/17/84 

1117.2 

8838 

inp.  5 

01/17/84 

1122.2 

r w 

01/17/84 

1120.5 

2664 

inp.  6 

01/17/84 

1125.3 

r w 

01/17/84 

1125.3 

4293 

inp.  7 

01/17/84 

1129.8 

r w 

01/17/84 

1129.8 

3960 

i np . 8 

01/17/84 

1411.8 

r w 

01/17/84 

1411.8 

12807 

inp.  9 

01/17/84 

1413.2 

r w 

01/17/84 

1413.2 

9054 

inp.  10 

01/17/84 

1141.6 

r w 

01/17/84 

1140.2 

3789 

inp.  11 

01/17/84 

1150.3 

r w 

01/17/84 

1150.3 

7641 

inp.  12 

01/17/84 

1153.7 

rew 

01/17/84 

1153.7 

5400 

inp.  13 

01/17/84 

1155.8 

r w 

01/17/84 

1155.8 

6345 

inp.  14 

01/17/84 

1156.8 

r w 

01/17/84 

1156.8 

5580 

inp.  15 

01/17/84 

1157.7 

rew 

01/17/84 

1157.7 

5571 

inp.  16 

01/17/84 

1414.1 

rew 

01/17/84 

1414.1 

7848 

i np . 1 7 

01/17/84 

1414.9 

rew 

01/17/84 

1414.9 

12132 

inp.  18 

01/17/84 

1416.0 

r w 

01/17/84 

1416.0 

9279 

inp.  19 

01/17/84 

1418.2 

r w 

01/17/84 

1418.2 

14184 

inp. 20 

01/17/84 

1210.7 

r w 

01/17/84 

1210.7 

8010 

- 2 - 


inp.21 

01/19/84 

1456.5 

r w 

01/19/84 

1456.3 

3438 

inp.22 

01/19/84 

1456.5 

r w 

01/19/84 

1456.5 

5553 

inp.23 

01/26/84 

1751.1 

rew 

01/26/84 

1750.1 

5364 

inp.24 

01/26/84 

1805.7 

rew 

01/26/84 

1801 .4 

4950 

inp.25 

01/26/84 

1813.2 

rew 

01/26/84 

1812.4 

5328 

inp. 26 

01/26/84 

1824.4 

rew 

01/26/84 

1823.1 

4941 

inp.27 

02/21/84 

1904.3 

r w 

02/17/84 

2126.2 

5733 

inp. 28 

02/21/84 

1904.3 

r w 

02/21/84 

1855.9 

6309 

inp. 29 

02/21/84 

1904.3 

rew 

02/21/84 

1857.0 

4815 

inp. 30 

02/21/84 

1904.3 

rew 

02/21/84 

1857.3 

4302 

inp. 31 

02/21/84 

1904.3 

rew 

02/21/84 

1859.6 

4788 

inp. 32 

02/21/84 

1904.3 

rew 

02/21/84 

1901.6 

4149 

inp. 33 

02/21/84 

1904.3 

rew 

02/21/84 

1902.7 

3078 

inp. 34 

02/21/84 

1904.3 

rew 

02/17/84 

2126.3 

3357 

inp. 35 

02/21/84 

1904.3 

rew 

02/17/84 

2126.3 

3258 

inp. 36 

02/21/84 

1904.3 

rew 

02/17/84 

2126.3 

3681 

inp. 37 

02/21/84 

1904.3 

rew 

02/17/84 

2126.3 

4122 

inp. 38 

02/21/84 

1904.3 

rew 

02/21/84 

1904.3 

3753 

inp. 39 

03/19/84 

1334.5 

rew 

03/19/84 

1314.4 

5121 

inp. 40 

03/19/84 

1334.5 

r w 

03/19/84 

1334.0 

6498 

inp. 41 

03/19/84 

1247.8 

rew 

03/19/84 

1240.0 

3123 

inp. 42 

03/19/84 

1247.8 

rew 

03/19/84 

1240.6 

3330 

inp. 43 

03/19/84 

1247.8 

rew 

03/14/84 

1742.1 

4311 

inp. 44 

03/19/84 

1247.9 

r w 

03/19/84 

1241.2 

4167 

inp. 45 

03/19/84 

1247.9 

rew 

03/14/84 

1800.2 

3798 

inp. 46 

03/19/84 

1247.9 

rew 

03/19/84 

1242.0 

4302 

inp. 47 

03/19/84 

1247.9 

r w 

03/19/84 

1242.7 

3924 

inp. 48 

03/19/84 

1247.9 

rew 

03/19/84 

1243.5 

3501 

i np . 49 

03/19/84 

1248.0 

r w 

03/19/84 

1244.9 

4473 

> udd  >N^SA/RBOCN>N\SA.me  e t i ng_jxo  t e s 

quota  = 0; 

used  = 9 

Segments  = 

1,  Lengths  = 9. 

r w 9 

NASA.il/14/83.meeting 
n. archive 

.archive 

>udd>E®/B>N\SA/RBOCN>NASA.mee  t ing_jiotes  >N\SA.  11/14/83 

.meeting . archive 

name 

Updated 

mode 

modified 

length 

NASA,  probl  ans  . rtmof  f 

01/06/84 

1322.3 

r 

w 

01/06/84 

1321.6 

15975 

NASA.marketing  plan. runoff 

01/06/84 

1329.9 

r 

w 

01/06/84 

1329.0 

75798 

NASA.  3/4_year_j)lan.  runoff 

01/06/84 

1327.9 

r 

w 

01/06/84 

1327.7 

54270 

NASA. course_contents . runoff 

01/06/84 

1326.0 

r 

w 

01/06/84 

1325.4 

83763 

NASA.  course__notes  . runof  f 

01/06/84 

1339.7 

r 

w 

01/06/84 

1338.8 

21123 

NASA.  survey_notes  . runof  f 

01/06/84 

1335.7 

r 

w 

01/06/84 

1335.0 

10332 

NASA. proposal  s__notes  . runof  f 

01/06/84 

1337.7 

r 

w 

01/06/84 

1336.9 

25902 

NASA.marketing_notes . runoff 

01/06/84 

1333.7 

r 

w 

01/06/84 

1333.3 

7659 

NASA.  l/2_contract__notes . runoff 

02/11/84 

2350.5 

r 

w 

02/11/84 

2350.5 

5427 

>udd  >DBVE>NASA/RBOCN>N^SA.RA^ee  t ing_jiot  es 
quota  = 0;  used  = 12 

Segments  = 1,  Lengths  = 12. 

rew  12  N^\SA.RAj7ieet  ing_jiotes  . archive 
r .archive 


> udd >D0vS >NASA/REOCN>N^SA.RAjnce t ing  notes  >NASA.RAj:Bee t ing  notes  .archive 


name 

updated 

mode 

modified 

length 

NnSA.RA^iOtes  . runof  f . ec 

04/07/84 

0350.9 

rew 

04/07/84 

0350.9 

1998 

N<\SA.RA^otes  . runof  f 

04/07/84 

0350.9 

r w 

04/07/84 

0350.9 

5004 

H^SA.RA^otes  .contents . runoff 

04/07/84 

0350.9 

r w 

04/07/84 

0350.7 

5634 

NASA.RA^otes  .01/14/84.  runoff 

02/28/84 

1702.1 

r w 

02/28/84 

1701.7 

41499 

N<\SA.  tasks/status,  runoff 

06/01/84 

1308.1 

rew 

06/01/84 

1308.1 

214065 

N^.RA_Jiotes  .01/18/84.  runoff 

02/28/84 

1702.1 

rew 

02/28/84 

1701.8 

36396 

N^.R\_jiotes  .01/25/84.  runoff 

02/28/84 

1702.1 

rew 

02/28/84 

1701.8 

29493 

N^.RA-Jiotes  .02/16/84.  runof  f 

02/28/84 

1757.2 

rew 

02/28/84 

1756.4 

18000 

NASA.RA^otes  .03/12/84.  runoff 

04/07/84 

0409 . 3 

rew 

04/07/84 

0409 . 3 

14283 

mSA.RA^agenda. 05/08/84. runoff  05/09/84 

1336.2 

r w 

05/09/84 

1334.9 

20394 

N^SA.RA_Jiot es  .05/15/84.  runoff 

05/21/84 

2333.9 

rew 

05/21/84 

2333.9 

16839 

>udd>D0vC>N^LSAyRBCCN>NASA.  admin  i s t rat  i on 

quota  = 0;  used  = 54 

quota  used 

directory  name 

0 15 

mSA.FY83-84.final_report 

0 15 

Total 

Segments  = 3,  Lengths  = 39. 

rw  1 H\SA.RA.mai  1 . ec 

r w 1 N^SA.RA.mail 

rw  37  N^SA. administration. 

archive 

a .archive 

> udd  >DBs/lS  >N^SA/REOCN>N^SA.  admin  i s t rat  ion>hi^SA.  admin  i strati  on.  archive 

name 

updated 

mode 

modi f i ed 

length 

NASA.  reading_jnater ial  .mail 

12/22/83 

2003 . 2 

r w 

12/22/83 

2000.0 

24345 

NASA.’WPS.mai  1 . ec 

01/21/84 

2020.4 

r w 

01/21/84 

2020.4 

1854 

NASA.V/PS .mail  .01/21/84 

01/21/84 

2021.1 

r w 

01/21/84 

2021.1 

17928 

NASA.workshop_attendees . runoff  02/20/84 

1138.9 

rew 

01/27/84 

1647.1 

22329 

N^SA.workshop_evaluat ion. runoff  02/20/84 

1145.1 

rew 

02/08/84 

1543.2 

29196 

NASA.WDrkshop_suninary . runoff 

02/20/84 

1611.0 

rew 

02/20/84 

1458.7 

112212 

4 - 


• 

NASu^. REPORT- 1 . cover_4)age  . runof  f 

02/28/84 

2138.0 

r 

w 

02/28/84 

1452.9 

4851 

XASA. REPORT-1 . contents  . runoff 

02/28/84 

2138.1 

r 

w 

02/28/84 

2135.1 

45540 

N^SA.REPCRT-1 . attachments  . runof f 02/29/84 

1503.8 

rew 

02/29/84 

1409.0 

20070 

N'\SA.workshop__resul  ts  . archive 

02/28/84 

2141.3 

rew 

02/20/84 

1144.7 

132480 

N'^SA.v.^^s  .ma  i 1 . ec 

03/13/84 

1635.2 

r 

w 

03/13/84 

1249.4 

2007 

N^\5A.wps  .mai  1 

03/13/84 

1635.3 

r 

w 

03/13/84 

1627.7 

20439 

NAlSA^GSO.  1 e t ter  . 03/26/84 . runof  f 

03/24/84 

1417.7 

r 

w 

03/24/84 

1417.2 

15057 

NASA.  PC.  JW-.cover_ietter  . runoff 

04/06/84 

1731.6 

r 

w 

04/06/84 

1712.6 

75186 

NASA . OLTTL INES  AT  SUALS . t op  i c s 

03/28/84 

2258.8 

r 

w 

03/28/84 

2233.9 

4410 

NASA.GSO.  IHL.  letter  . runoff 

03/29/84 

1223.1 

r 

w 

03/29/84 

1222.5 

17676 

NASA.GSO.  SG.  1 e 1 1 e r . runof  f 

03/29/84 

1211.0 

r 

w 

03/29/84 

1208.1 

17676 

NASA.PC_proposal . runoff 

04/06/84 

1731.6 

r 

w 

04/06/84 

1705.3 

127584 

NASA.  PC_propos a l_two . runof  f 

03/29/84 

1441.1 

rew 

03/29/84 

1435.1 

139518 

NASA. PC ■ HP  2600 . i nf o ^ runoff 

04/07/84 

1113.9 

rew 

04/07/84 

0143.1 

14589 

NASA. RA_t asks  .04/09/84.  runoff 

04/09/84 

1326.5 

r 

w 

04/09/84 

1315.0 

40995 

NASA. RA_t asks  .04/13/84.  runoff 

04/13/84 

1754.9 

r 

w 

04/13/84 

1753.6 

32769 

NASA.GSO.  1 e 1 1 e r . 04/16/84 . runof  f 

04/16/84 

1012.9 

r 

w 

04/16/84 

1011.4 

15084 

NASA.  JK. let ter.04/16/84. runoff 

04/16/84 

1035.0 

r 

w 

04/16/84 

1031.4 

12042 

NASA.GSO.ARS  .letter,  runoff 

04/23/84 

1030.8 

r 

w 

04/23/84 

1026.5 

17190 

NASA . GSO . KHN . letter,  runof  f 

04/23/84 

1054.0 

r 

w 

04/23/84 

1052.7 

17217 

NASA.GSO.  ST.  1 e 1 1 er  . runof  f 

04/23/84 

1127.2 

r 

w 

04/23/84 

1110.5 

17586 

NASA.GSO. letter. 04/26/84 . runof  f 

04/26/84 

1311.9 

r 

w 

04/26/84 

1303.1 

17865 

NASA.RA.ma  i 1 . ec 

08/03/84 

1523.9 

r 

w 

08/03/84 

1523.9 

1575 

NASA. RA. mai  1 

07/03/84 

1904.4 

r 

w 

07/03/84 

1858.2 

1098 

NASA.  PC.  IBM_letter  . runoff 

05/02/84 

1750.6 

r 

w 

05/01/84 

1453.5 

12582 

• 

NASA,  installation.ee 

05/05/84 

1716.4 

r 

w 

05/05/84 

1639.2 

15228 

NASA,  installation.g.ec 

05/05/84 

1716.4 

r 

w 

05/05/84 

1623.6 

1719 

NASA. installation.u.ec 

05/05/84 

1716.4 

r 

w 

05/05/84 

1636.3 

1755 

NASA,  installation .mb?^l  ink.ee 

05/05/84 

1704.4 

r 

w 

05/05/84 

1703.5 

6885 

NASA,  installati  on  .RA^ael  . ee 

06/04/84 

1341.4 

r 

w 

06/04/84 

1228.2 

3366 

NASA,  installation. dfcms_pmf 

05/05/84 

1716.8 

r 

w 

05/05/84 

1712.3 

13347 

NASA,  installati on. person  ids 

06/04/84 

1208.8 

r 

w 

06/04/84 

1208.8 

1584 

NASA. mai  1 . ec 

07/03/84 

1904.4 

r 

w 

07/03/84 

1902.5 

2682 

NASA. mai  1 

07/03/84 

1904.4 

r 

w 

07/03/84 

1904.0 

567 

NASA. workbench. mai  1 . ec 

05/09/84 

1758.1 

r 

w 

05/09/84 

1758.1 

1224 

NASA.workbench.mai  1 

05/09/84 

1758.6 

r 

w 

05/09/84 

1757.5 

9963 

NASA.works  tat  ion.05/10/84.  runof f 05/ 10/ 84 

1226.7 

r 

w 

05/10/84 

1226.7 

21627 

NASA.  sumner_4)articipants 

06/04/84 

1341.4 

r 

w 

06/04/84 

1239.0 

5967 

NASA.  installation.669_acl .ec 

06/04/84 

1328.9 

r 

w 

06/04/84 

1328.6 

2313 

SU.REPCRT-2 . cover  page , runof f 

06/13/84 

1655.4 

r 

w 

06/12/84 

1217.0 

3276 

SU.  REPORT-2 . contents . runof  f 

06/13/84 

1655.4 

r 

w 

06/12/84 

1508.1 

63765 

SU.REPCX^T-2 .attachments  . runof f 

06/18/84 

0831.1 

rew 

06/13/84 

1835.3 

23265 

NASA.  PC.PQ_IHvl.changes  . runof  f 

06/18/84 

1030.6 

r 

w 

06/18/84 

0948.6 

15219 

NASA.Q4PS669 . de  1 e t e_jac  1 . abs  in 

07/31/84 

2113.3 

r 

w 

07/31/84 

2113.3 

16992 

NASA.RA^tasks .08/04/84 

08/13/84 

1815.7 

r 

w 

08/04/84 

1933.5 

49050 

• 

>udd>D^/B>N^SAyRBOCN>N^SA.  admin  i s trat  i on> 
quota  = 0;  used  = 15 

Segments  = 3,  Lengths  = 15. 

r w 5 N^SA..FIhM-.  contents  . runout 

r w 5 N\SA.FIN^.  contents  . rimoff 

- 5 - 

NASA.FY83 

-84 

f inal_report 

n. runoff 
n 

rw  5 N^SA.Pi['83-84.finalreport  .archive 
r .archive 


>udd>DEv'E>N^SA/REOCN>NASA.  admini  s t ra t i on>N^\SA.FY83-84 . f inaLrepor t . f ina  1 rep 


name 

updated 

mode 

modif i ed 

1 ength 

NASA. FINAL. cover  page , runof f 

08/03/84 

1520.6 

r 

w 

08/03/84 

1520.3 

0 

NASA. FINAL,  execut  i ve_sum.  runoff 

08/03/84 

1520.6 

r 

w 

08/03/84 

1520.3 

0 

NASA.  FINAL,  contents,  runof  f 

08/13/84 

1553.1 

r 

w 

08/13/84 

1553.1 

152118 

NAiA.FINAL.  a t tachment s . runof  f 

08/03/84 

1520.6 

r 

w 

08/03/84 

1520.3 

0 

> udd  >DBvE>N\SA/RB03^>NASA.  publ  i ca  t i ons 
quota  = 0;  used  = 13 

quota  used  directory  name 

0 9 NASA. publ icat ions .pending 

0 9 Total 


Segments  = 1,  Lengths  = 4. 

r w 4 NASA. publications  .archive 
p . archive 


> udd  >DHvE>NASA/RBOCN>NASA.  publ  i cat  ions  >NASA.publ  i ca t i ons . archive 

^2me  updated  mode  modified  length 

NASA.AEDS.abstract . runoff  01/16/84  0931.3  rw  01/16/84  0930.5  19476 

NASA.AEDS.foi Is . runoff  01/27/84  1855.4  rw  01/27/84  1854.2  102024 

> udd  >DHvB>N^SA/RBOCN>NASA.  publ  i cat  ions  >N^SA.  publ  i cat  ions  .pending 
quota  = 0;  used  = 9 

Segments  = 1,  Lengths  = 9. 

rw  9 NASA. HICSS . ses  s i on . archive 
h. archive 


> udd  >DHvK >NASA/RBOCN>NASA.  pub  1 i c a t i ons  >NASA.  publ  i ca t i ons  . pend i ng  >NASA.HICSS . s e s s i on . a r ch 

name  updated  mode  modified  length 

NASA.HICSS.JW. 06/05/ 84. runoff  06/05/84  1422.6  rw  06/04/84  2041.9  13977 

NASA. HICSS.sessiorL-tasks. runoff  06/05/84  1422.6  rw  06/04/84  2019.4  9837 


- 6 - 


N^^SA.HICSS.part  icipants  . runoff 

08/03/84 

1423.0 

r 

w 

08/03/84 

1406.6 

10062 

NASA.HICSS . s es s i oiv_topi  cs  . runof  f06/ 19/84 

1004.7 

r 

w 

06/07/84 

1211.8 

3627 

N^SA.HICSS . deadl  ines  . runof  f 

07/19/84 

0703.1 

r 

w 

07/19/84 

0703.1 

14337 

NASA.HICSS.  session_theme  . runoff 

07/29/84 

1536.5 

r 

w 

07/29/84 

1523.3 

73917 

NASA.HICSS . s e s s i on_t  i 1 1 e s . runof  f 06/19/84 

1438.3 

r 

w 

06/19/84 

1418.0 

1908 

NASA.HICSS . invi t e_l  e t ter . runof  f 

07/19/84 

0725.9 

r 

w 

07/19/84 

0725.9 

18117 

>«t\SA.HlCSS.JK. 07/19/84.  runoff 

07/19/84 

0859.1 

r 

w 

07/19/84 

0730.3 

18738 

NASA. HICSS.VH. 07/19/84.  runoff 

07/19/84 

0859.3 

r 

w 

07/19/84 

0816.8 

19179 

N\SA . mess . RD . 07  / 1 9 / 8 4 . r uno f f 

07/19/84 

0859.4 

r 

w 

07/19/84 

0815.4 

19062 

NASA. mess. USL. 07/19/84.  runoff 

07/19/84 

0931.2 

r 

w 

07/19/84 

0924.1 

20448 

NASA. HieSS.su. 07/19/84. runoff 

07/19/84 

0931.4 

r 

w 

07/19/84 

0929 . 1 

19251 

NASA. mess. CM. 07/23/84.  runoff 

07/23/84 

1518.0 

r 

w 

07/23/84 

1504.9 

18819 

NASA. mess. RD. 07/30/84.  runoff 

07/29/84 

1557.5 

r 

w 

07/29/84 

1554.7 

22734 

NASA.HieSS. Be. 08/03/84.  runoff 

08/03/84 

1423.2 

r 

w 

08/03/84 

1411.6 

18882 

'*  udd>D0vB>N\SA/RBOCN>N^SA.WDrki  ng paper e r i es 

quota  = 0;  used  = 119 


quota  used 


di rectory  name 


0 0 
0 0 


wps_pending 
wps review 


0 0 


Total 


Segments  = 2,  Lengths  = 119. 

r w 17  N\SA.  PC_J^&ELpaper_s er  i es  . archive 
p. archive 

r w 102  N^^SA.worki rL4>aper ^series  .archive 

. w.  archive 


>udd>DHvB>NASAyRBDCN>N^SA.working_4)aper_seri  es  >N^\SA.PCJiS£)_4)aper_series  .archive 


name 

DHvB  .N\SA/PC_P&D.  runof  f . ec 
E®vB  .mSA/PCJia>X.  f 
I®vtS  .N^SA/PC_RSD“1 . runof  f 
E0vC  .NASA/PC_JWa>“2 . runof  f 
DBs/E  .N^^SA/PC_Jia>3 . runoff 
E®vK  .N^SA/PCJ^^4 . runoff 
D0vC  .NASA/PCJi®-5 . runoff 
D0^  ,mSA/VQ_my6 . runoff 
DHVB  .N\SA/PC3a>7 . runoff 
DHvB  .N^\SA/PC_J^Sd>8 . runoff 


updat 

ed 

mode 

07/07/84 

1353.5 

r w 

runoff07/07/84 

1454.0 

r w 

07/07/84 

1648.7 

rew 

08/11/84 

0938.9 

rew 

08/01/84 

1208.9 

rew 

08/02/84 

1739.9 

rew 

08/13/84 

1322.4 

rew 

08/02/84 

1414.7 

r w 

08/02/84 

1715.9 

rew 

08/02/84 

1414.8 

r w 

modified  length 


07/07/84 

1352.8 

0 

07/07/84 

1445.2 

21888 

07/07/84 

1646.7 

42210 

08/11/84 

0938.9 

56322 

08/01/84 

1156.1 

83178 

08/02/84 

1735.8 

211095 

08/06/84 

0931.9 

116505 

08/02/84 

1414.4 

0 

08/02/84 

1501.8 

70812 

08/02/84 

1414.4 

0 

udd >DHvB >NASA/RE03^^Ni^\SA.WDrki ng pape r ^s er  i es  >N\SA.workin  pape r er  i es 

Game  updated  mode  mod  i f i ed 


archive 

length 
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D0vC  .NASA/RBOCN.  runof  f . ec 

01/16/84 

0946 . 5 

r w 

01/16/84 

0946.2 

0 

D0vE  .NASA/RBOCN-X.  rf_params 

06/03/84 

0221.8 

r w 

06/03/84 

0221.8 

2214 

D0vC . NASA/RBOCN- 1 .archive 

06/03/84 

0330.9 

r w 

06/03/84 

0330.9 

71280 

DHVS  . NASA/RBOCN- 2 .archive 

06/03/84 

0246.0 

r w 

06/03/84 

0245.0 

906768 

D0vC  .NASA/RBOCN-3  .archive 

06/03/84 

0310.4 

r w 

06/03/84 

0310.4 

144576 

D0vC  .NASA/REOCN-X.  cover_4>age 

01/22/84 

0444 . 1 

r w 

01/22/84 

0441.9 

18855 

DBvC.N-kSA/RBCCN.  STAhO^.  archive03/31/84 

2018.7 

rew 

03/31/84 

2018.7 

334584 

D0VS  .NASA/RBOCN.  STD.  runoff  . ec 

03/31/84 

2018.7 

rew 

03/31/84 

2014.8 

2025 

D0vB  .NASA/RBOCN-4  .archive 

05/30/84 

1100.0 

rew 

05/29/84 

1655.9 

762264 

D0vB  .NASAy'RBOCN-5  .archive 

06/07/84 

1640.7 

rew 

06/07/84 

1438.1 

964476 

DBvC  .NASA/RBOCN-6  .archive 

06/07/84 

1656.0 

rew 

06/06/84 

1840.3 

509508 

>udd>DBvE>NASAyRBOCN>NASA,WDrking  paper  seri  es  >wp<;^endi  ng 
quota  = 0;  used  = 0 

Di  rectory  empty:  >udd>DBvfS>N'\SA/RBOCN>N^SA.WDrking  paper  seri  es  >wps_pending 

> udd >D^v€>N^\SAy RE0CN> NASA. working  paper ^ser  i es  >wps revi  ew 

quota  = 0;  used  = 0 

quota  used  directory  name 

0 0 pending 

0 0 Total 

Segs=0;Msf  s=0;Di rs=l ;Links=0. 


> udd  >DBv1S>  NASA/ RBOuN>NASA.  working  paper ^series  >wps  revi  ew>  pend  ins 

quota  = 0;  used  = 0 

Directory  empty:  >udd>DHvK>N^SA/RBOCN>N\SA.WDrking  paper ^series>wps ^review>pending 

> udd>DB^>NASA/RBCEN>NASA.CMPS669 . s tudent_tasks 
quota  = 0;  used  = 4 

Segments  = 1,  Lengths  = 4. 

rw  4 N^SA. 669 . s tudent tasks  . archive 

s .archive 


> udd>D0vtS >NASA/RBOCN>N\SA.Qv1PS669 . student tasks  >N^SA. 669 ♦ s tudent ^tasks  .archive 

ti2me  updated  mode  modified  length 

NASA. 669. student_tasks. runoff  06/11/84  0854.6  r w 06/07/84  0824.5  132552 

>udd>D0vB>N^SA/RBCQ4>N\SA.  backup_tapes 
quota  = 0;  used  = 12 

Segments  = 4,  Lengths  = 12. 

rew  6 tape _J546.map 

rew  6 N\SA.DEvC_Jbackup_tape  . ta 

D0vC.tape_3546.NASA/D0vC_dirs 
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d . ta 

r w 0 N\SA.  save_Jbackup_tape  . ta 
DBv^.tape _^544  .N^SA^save 
s . ta 

r w 0 NASA.Q^^S669_backup__tape . ta 

Dev«.  tape_3545.N^a^CMPS669_dirs 
c . ta 


>udd>DHvB>N\SAyRBOCN>NASA.  laser_f  ormat s 
quota  = 0;  used  = 358 


di rectory  name 

NASA.  laser__copies requi  red 

Total 

Segments  = 3,  Lengths  = 356. 


quota  used 

0 2 

0 2 


rw  109  NASA.  laser_J‘ormats  . archive 
1 . archive 

rw  1 NASA.  laser__formats  . 1 . contents 
1 . contents 

r w 246  NASA.  laser_J*ormats  . 1 .archive 
1 . archive 


> udd >2^iASA/RB0CN>N^SA.  1 as er__f ormats >N^SA.  1 aser__f orma t s .1  .archive 


name  updated  mode  modified  length 


NASA.AEDS  .foils. laser 

02/20/84 

1136.3 

rew 

02/10/84 

1317.7 

100503 

N^SA.AEDS.  foil  s_4/5  .laser 

02/20/84 

1137.0 

r ew 

02/10/84 

1339.3 

16560 

N^SA.workshop_evalua  t i on . laser 

02/20/84 

1144.8 

rew 

02/08/84 

1628.4 

30420 

NASA.workshop_suninary . laser 

02/20/84 

1615.2 

rew 

02/20/84 

1614.9 

122643 

QvlPS669 . extended_syl  labus  .laser 

02/28/84 

1414.2 

r 

w 

02/28/84 

0903 . 2 

132426 

NASA,  problems  .laser 

02/28/84 

1414.8 

r 

w 

02/28/84 

0905.9 

19926 

NASA.marke t ing  plan. laser 

02/28/84 

1414.9 

r 

w 

02/28/84 

0917.7 

96093 

N^SA.  3/4_year_plan.  laser 

02/28/84 

1414.9 

r 

w 

02/28/84 

0921.3 

64935 

NASA.  course_con tents  .laser 

02/28/84 

1415.0 

r 

w 

02/28/84 

0925.0 

109080 

NASA.  course_jiotes  .laser 

02/28/84 

1415.6 

r 

w 

02/28/84 

1115.6 

25623 

NASA.  survey_notes  .laser 

02/28/84 

1415.7 

r 

w 

02/28/84 

1118.9 

12006 

NASA.proposals_jiotes  .laser 

02/28/84 

1415.7 

r 

w 

02/28/84 

1128.2 

32562 

N^SA.market  ing_jiotes  .laser 

02/28/84 

1415.8 

r 

w 

02/28/84 

1131.7 

8901 

NASA.  l/2_contract_jiotes  .laser 

02/28/84 

1415.8 

r 

w 

02/28/84 

1135.9 

6678 

NASA. 669. s tudent_tasks .laser 

02/28/84 

1416.4 

rew 

02/28/84 

1145.7 

202644 

NASA,  tasks /status .laser 

02/28/84 

1416.5 

rew 

02/28/84 

1344.1 

245547 

DHvC  .NASA/RBCa4,^M]A^^^ 

02/28/84 

1417.3 

r 

w 

02/28/84 

1242.0 

284832 

DBVB  .NASA/RBCCN-2 . 1 a s e r 

02/28/84 

1417.6 

r 

w 

02/28/84 

1227.9 

1196559 

D0v^  .NASA/RBCOSh3 . 1 a s e r 

02/28/84 

1417.8 

r 

w 

02/28/84 

1201.6 

210276 

NASA.REPCRT-1 . cover__page  .laser 

02/29/84 

1308.6 

r 

w 

02/29/84 

1212.0 

8775 

NASA.REPQH'-l  .con  tents. laser 

02/29/84 

1308.8 

r 

w 

02/29/84 

0525.5 

52344 
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N^SA.REPCRT-1 . attachments  .laser 

02/29/84 

1502.9 

r w 

02/29/84 

1449.3 

32067 

D0v«.N^\SA/RBCX3^1  .laser 

02/29/84 

1546.6 

r w 

02/29/84 

1519.0 

112554 

DBvB  .N^\SA/RBCCN.D0v/5_s  t rue  ture 

02/29/84 

1610.6 

r w 

02/29/84 

1558.2 

141840 

N^SA.  que  s t i onna  ire.  JW.  laser 

03/21/84 

1434.1 

rew 

03/21/84 

1312.9 

22833 

NA5A.  que  s t i onna ire.  JWl  ist. laser 

03/21/84 

1434.4 

rew 

03/21/84 

1317.1 

17118 

N^\SA.  quest!  onna  ire.  cover  .laser 

03/21/84 

1434.9 

rew 

03/21/84 

1305.9 

42939 

N\SA.  quest! onnai re . laser 

04/02/84 

2050.8 

rew 

04/02/84 

2015.0 

98559 

hASA.GSO.SG.  letter  . runout  .laser 

03/31/84 

2043.0 

rew 

03/29/84 

1610.7 

19044 

N^SA.GSO.  IHL.  letter,  runout . laser03/31/84 

2043.2 

rew 

03/29/84 

1609.0 

18810 

NASA.PC.  JW_cover__letter . laser 

04/07/84 

1115.7 

rew 

04/07/84 

0838.8 

83808 

NASA.PCLproposal .laser 

04/07/84 

1115.8 

rew 

04/07/84 

0838.8 

157194 

Demini  cl^^.  l_page__resume  .laser 

05/23/84 

1556.6 

rew 

05/22/84 

1509.2 

32886 

Domini  cl^i^D.bioL_sketch.  laser 

05/23/84 

1556.7 

rew 

05/21/84 

1618.9 

8442 

Cl . par  i s__paper  . laser 

07/11/84 

1726.6 

r ew 

07/11/84 

1331.3 

252540 

Cl  .pari  s_J‘rench_abs  tract  .laser 

07/11/84 

1727.9 

rew 

07/11/84 

1438.8 

32553 

N^SA.HICSS . sess  i oiL-.theme  .laser 

08/01/84 

1533.7 

rew 

07/30/84 

0930.8 

82665 

N^SA.  HICSS.de ad 1 ines. laser 

07/19/84 

1110.5 

rew 

07/19/84 

1032.4 

19620 

DEvB.mSA/RBXN.STANI>\RD.  laser 

08/01/84 

2201.4 

rew 

08/01/84 

2109.4 

452187 

NASA. 669.  student_t asks  . sum.  laser08/01/84 

2204.3 

rew 

08/01/84 

1816.0 

215595 

DHvB  .M'^SA/RHXN-5 . 1 a s e r 

08/01/84 

2247.7 

rew 

08/01/84 

2109.8 

1424826 

N^SA.document_templates  .laser 

08/01/84 

2308.7 

rew 

08/01/84 

2125.2 

69003 

N^SA.CXJTLINES . specs,  laser 

08/01/84 

2310.4 

rew 

08/01/84 

2110.3 

89388 

N^SA.VISUALS . specs . laser 

08/01/84 

2311.0 

rew 

08/01/84 

2110.3 

150264 

DHvB  .NASA/RBCnSf-4 . 1 a s e r 

08/01/84 

2312.5 

rew 

08/01/84 

2300.1 

1096146 

D0vB  .NASA/RHXN-6 . 1 a s e r 

08/01/84 

2315.9 

rew 

08/01/84 

2109.8 

735129 

DHvB  .NASA/PC_RaD-2 . 1 a s e r 

08/01/84 

2317.4 

rew 

08/01/84 

2144.1 

88497 

D0^.NASA/PC_Ra>3.  laser  • 

08/01/84 

2318.0 

rew 

08/01/84 

2144.1 

122976 

NASA.NASA/RBXN.db_j  tatus  . laser 

08/01/84 

2319.1 

rew 

08/01/84 

2125.2 

407889 

> udd  >D0vC  > NASA/ RECCN>  NASA,  laser formats  >NASA.  laser f orma  t s .archive 

name 

updai 

ted 

mode 

modi f i ed 

1 eng  th 

NASA.universi ty/ti tle_l  ist. laser08/03/84 

1119.7 

rew 

08/02/84 

1824.1 

672138 

DevB  .NASA/ PC_B,a>5 . 1 a s e r 

08/03/84 

1120.7 

rew 

08/02/84 

1740.0 

185652 

DHV1S  .NASA/PCJia>7 . 1 a s e r 

08/03/84 

1121.5 

rew 

08/02/84 

1740.0 

108486 

NASA.  IS6®.db_s tatus  . laser 

08/03/84 

1125.8 

rew 

08/02/84 

1908.0 

1969092 

NASA.HvE.db_s  tatus  .laser 

08/03/84 

1125.9 

rew 

08/02/84 

1228.8 

685674 

D0sE  .NASA/PC_RS£)-4 . 1 a s e r 

08/03/84 

1133.4 

rew 

08/02/84 

1903.8 

312084 

NASA.multics_WDrkbench.  laser 

08/03/84 

1318.7 

rew 

08/03/84 

1254.0 

76383 

> udd  >D^/B>NASAyRE03^>NASA.  1 as  e r forma  t s >hl^SA.  laser copi  es ^requi  red 

quota  = 0;  used  = 2 

Segments  = 2,  Lengths  = 2. 

rew  1 laser328.ec 

rew  1 laser_ec . archive 


>udd>D^4S>N^SA/RECQ'I>NASA.  laser formats >N^SA.  laser_copi es r equi  r ed>  laser ec  .archive 
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name 


updated 


mode 


modif i ed 


length 


laser_4>ass2 . ec 

08/11/84 

0745.5 

r w 

08/01/84 

2108.1 

3960 

laser_prop_spacing . ec 

08/11/84 

0745.5 

rew 

08/02/84 

1227.9 

3960 

1 ase r_jirf  . ec 

08/11/84 

0745.5 

rew 

08/02/84 

1818.2 

2700 

laser328 . ec 

08/11/84 

0745.5 

rew 

08/11/84 

0745.0 

3861 

>udd>DHvB>N\SA/RBOCN>N^SA.mul  t i cs_jvDrkbench 
quota  = 0;  used  = 236 


quota 

used 

directory  name 

0 

8 

specifications 

0 

11 

design 

0 

222 

in5>lementation 

0 

2 

testing 

0 

243 

Total 

Segments  = 1,  Lengths  = 1. 

rew  1 tintegri  ty^controL-file 

>udd>DHv^>NASA/RB3C>I>NASA.mul  t i cs_5VDrkbench>  specif  i cations 
quota  = 0;  used  = 8 

Segments  = 5,  Lengths  = 8. 


rew 

1 

plans . runoff 

rew 

2 

f inal_report . runof  f 

rew 

2 

workbench^repor t . runof  f 

rew 

1 

workbench/ s ta tus . runoff 

rew 

2 

N\SA.workbench_specs  . runof  f 
s . runoff 

> udd> 

DHvB>N\SA/RB0CN>N^SA.rnul  t i cs_jvorkbench 

quota 

= 0;  used  = 11 

Segments 

= 4 , Lengths  = 11 . 

rew 

2 

workbenclu-Sys  tems_jioc  . runof  f 
wsd.  nmoff 

rew 

5 

WorkbenchLjnanual . runof  f 
wn.  runoff 

rew 

2 

check-up.  info 

r w 

2 

mul t i cs_workbench . report .archive 
d. archive 

>udd>DBvB>N\SA/REOCN>N\SA.mul  t i cs_5vorkbench>des  i 
iianie  updated 


gn>mul  t i cs_3vorkbench.  report  .archive 
mode  modified  1 ength 
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Manna ri tsaki sS. cover . runoff  05/06/84 
Marmar i tsakisS. report. runoff  05/06/84 
workbench. review. 05/06/84. runof f05/06/84 


0931.1  rew  05/06/84 

0931.2  rew  05/06/84 
0953.5  r w 05/06/84 


0324.9 

0325.0 

0952.5 


> udd>DBvK>NASAyRBOCN>NiVSA.mul  t i cs_jvorkbench > impl  emen ta  t i on 
quota  = 0;  used  = 222 


quota 

used 

directory  name 

0 

61 

src_code 

0 

3 

ma  i 1_1  i s t s 

0 

2 

mai  l_segments 

0 

11 

s td 

0 

3 

N^WRHXN_P0CS 

0 

3 

a c c e s s 1 i s t s 

0 

83 

Total 

Segments  = 54,  Lengths  = 148. 


rew 

1 

sendLjnai  1 . chi  ef  . ec 

rew 

1 

sendLmai  1 .N\SAJ^  . ec 

rew 

1 

create .J*!  le 

rew 

12 

9utlay_docum 

rew 

1‘ 

ccnrpi  le2 . ec 

rew 

1 

ccffipi  1 e . ec 

rew 

1 

get_jdi  r__access 

rew 

1 

get__seg__access 

rew 

2 

integr  i ty__control 

rew 

2 

che  ck_s  eg_a  1 1 r i bu  t e s 

rew 

1 

enter_exec _jmxl  t__cQm 

rew 

1 

c h e c K_p  a t hn  ame 

rew 

2 

integr  i ty__control_func t ions 

rew 

2 

select_docum 

rew 

1 

combine . ec 

rew 

1 

tasks_ini  t_control 

rew 

1 

integr  i ty_control__f  i le 

rew 

1 

t2L-go . absout 

rew 

1 

append__f  i le . ec 

rew 

1 

checkal 1 .list 

rew 

1 

N^SA^outlays . runoff 

rew 

1 

N^SA^outlays . runout 

rew 

3 

NASA,  out  lays /status 

rew 

1 

combine_out . ec 

rew 

1 

out__date_change . ec 

rew 

1 

OLTILLBGB^S . runof  f 

rew 

1 

header . runout 

rew 

1 

GSCLal locations. runof  f 

rew 

1 

add__tQL_J  i s t . ec 

rew 

1 

sdm  base 

rew 

1 

create_J  i s t , ec 

5409 

19251 

17352 


12  - 


0 

N^SA/RBOCN.  logmai  Ibox  . sv.mbx 

0 

overdue_docs_jnai  Ibox.  sv.mbx 

rew 

12 

admini  s t rat  ive^unc  t ions 

rew 

1 

overdue_docs _mail.ee 

rew 

1 

1 i s t__f  ormai  ter _mail.ee 

rew 

1 

check^up_al  1 . ec 

rew 

1 

checij_up__one . ec 

rew 

1 

1 aser_res  tore . ec 

rew 

1 

laser_j:hange . ec 

rew 

1 

laser.ee 

rew 

1 

da  t exchange  . ec 

rew 

1 

heade  r . runof  f 

rew 

16 

N\SA.  tasks/s tatus 

r ew 

2 

T PTtFNPI^  runnff 

rew 

5 

cheetjup 

rew 

3 

workbench 

rew 

11 

checkout_document  s 

rew 

8 

document s_process  ing 

rew 

7 

ma i 1 i ng  1 i s t_f  o rma  1 1 e r 

rew 

7 

mai  1 ing__labels_4)rocessor 

rew 

4 

t ape_Jbackup__procedures 

rew 

1 

exec__mul  t__ccm 

rew 

15 

tastjiocum 

Mil  t i s egment-f  i les  = 1,  Lengths  = 7. 
r w 7 N-\SA/RBOCN JDOCS 

>udd>D0v^>N\SAyRBOCN>N^iSA.mul  t i c stiver kbench>  impl  ementat  i on>  src_code 
quota  = 0;  used  = 61 

Segments  = 1,  Lengths  = 75. 

rew  75  workbench.  SUvB4.  archive 

wbS. archive 


>udd>DHvB>N\SA/RBXN>NASA.mul  t i cs_workbench>  implementat  ion>  s rc__code>workbench.SUvB4.  arc 


name 

mai  1 in^  i s t_J‘ormatter  .pll 
mai  1 ing_Jabel  s_processor  .pll 
admin i strative_funct ions .pll 
checkout_document s .pll 
tape_Jbackup_procedures  .pll 
task^docum.  pi  1 
documents__proces s ing  .pll 
workbench. pll 
chectjup.pl  1 
exec_jnul  t__com.  pi  1 
ou  1 1 ay_docum.  p 1 1 
s e 1 ec  t_docum.  pi  1 


upda 

ted 

mode 

08/10/84 

1516.7 

rew 

08/10/84 

1516.7 

rew 

08/10/84 

1516.6 

rew 

08/10/84 

1516.7 

rew 

08/10/84 

1516.7 

rew 

08/13/84 

1744.8 

rew 

08/10/84 

1516.7 

rew 

08/10/84 

1516.8 

rew 

08/10/84 

1516.7 

rew 

08/10/84 

1516.8 

rew 

08/14/84 

0945.9 

rew 

08/10/84 

1516.5 

rew 

modified  length 


08/10/84 

1346.9 

184527 

08/10/84 

1345.1 

179865 

08/10/84 

1345.1 

339741 

08/10/84 

1355.1 

288891 

08/10/84 

1345.1 

71757 

08/13/84 

1739.2 

407484 

08/10/84 

1345.1 

188568 

08/10/84 

1356.2 

58653 

08/10/84 

1345.1 

193635 

08/10/84 

1345.1 

10503 

08/14/84 

0943.6 

322425 

08/10/84 

1512.7 

35703 

13  - 


integri  ty_cont rol_J“unc t i ons  .pll 

08/10/84 

1516.6 

rew 

08/10/84 

1452.4 

46926 

checkj)a thname  .pll 

08/10/84 

1516.6 

rew 

08/10/84 

1345.1 

8316 

enter_exec t_ccm.pl  1 

08/10/84 

1516.6 

rew 

08/10/84 

1345.1 

5157 

check_seg_att ributes  .pll 

08/10/84 

1516.6 

rew 

08/10/84 

1345.1 

58383 

create__f  i le  .pll 

08/10/84 

1516.6 

rew 

08/10/84 

1405.8 

10071 

integri ty_control .pll 

08/10/84 

1516.6 

rew 

08/10/84 

1448.0 

51318 

get_seg_access .pll 

08/10/84 

1516.6 

rew 

08/10/84 

1345.1 

28737 

g e t_d i r_a  ccess.pll 

08/10/84 

1516.6 

rew 

08/10/84 

1345.1 

26577 

exist .pll 

08/10/84 

1516.7 

rew 

08/10/84 

1413.8 

23112 

adnufiles  .pll 

08/10/84 

1516.7 

rew 

08/10/84 

1345.1 

54009 

tests. archive 

08/10/84 

1556.8 

rew 

08/10/84 

1556.9 

105480 

save . ec 

08/10/84 

1557.2 

r w 

08/10/84 

1520.7 

6561 

1 i s t , ec 

08/10/84 

1558.3 

rew 

08/01/84 

1452.0 

5166 

> udd  >DENC>Ni\SAyRBCO^>N^SA.mul  t i cs_3rork.bench>  inqil  ementa  t i on>mai  1 1 i s t s 

quota  = 0;  used  = 3 

Segments  = 3,  Lengths  = 3. 

rew  1 Group_l 

rew  1 N^SaIrAs 

rew  1 669_class 

> udd>D0vC>l't‘\SAyRBOCN>N'\SA.inul  t i cs_workbench>  inq)lanentat  i on>mai  l_segment  s 
quota  = 0;  used  = 2 

Segments  = 2,  Lengths  = 2. 

rew  1 manual 

rew  1 Monday 

> udd>DEviS>N^SA/RBQCN>N^SA.mul  t i cs_workbench>  impl  ementa  t i on>  s td 
quota  = 0;  used  = 11 

Segments  = 3,  Lengths  = 11. 

rew  2 OJTIAYS 

rew  8 TASKS 

rew  1 tasks init_control 

>udd>D0s^>N\SA/RBCCN>N^SA.mul  t i cs_3workbench>  iirpl ementa t ion > access_l  i s ts 
quota  = 0;  used  = 3 

Segments  = 3,  Lengths  = 3. 

rew  1 d i r_J.  i s t 

rew  1 testl 

rew  1 test 

>udd>D0vC>N^SA/RBOCN>Ni\SA.mul  t i cs_workbench>  testing 
quota  = 0;  used  = 2 

quota  used  directory  name 
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0 

2 

temp 

0 

1 

tempi 

0 

2 

ml  i 

0 

5 

Total 

Segments  = 

’ 1 , Lengths  = 2 . 

rew  2 

proc_docum.  runof  f 

> udd>D0^> NASA/ RBXN> NASA. rnul  t i cs_5VDrkbench>  testing^  tenm 

quota  = 0; 

used  = 2 

Segments  = 

' 2,  Lengths  = 2. 

rew  1 

1 i s t4 

rew  1 

list2 

>udd >DBvtS>NASAyRBXN>NASA.mul  t i cs_svDrkbench>  tes  t ing  > t empl 

quota  = 0; 

used  = 1 

Segments  = 

^ 1,  Lengths  = 1. 

rew  1 

xyzzy 

. ' 

>udd>D0/B>NASA/RBXN>NASA.mul  tics_jwrkbench>  testing >ml  i 

quota  = 0; 

used  = 2 

Segments  = 

= 2,  Lengths  = 2. 

rew  1 

check 

rew  1 

t es  1 1 

> udd >DB^>NASA/RBCCN>NASA. quest i onnai  re 

quota  = 0; 

used  = 86 

quota 

used 

directory  name 

0 

0 

questionnaire _4>ending 

0 

22 

ques  t i onnai  re_dat2Ljanalys  i s 

0 

22 

Total 

Segments  = 

= 2,  Lengths  = 64. 

rew  43 

Q^IRE.  archive 

r w 21 

N^SA.  questionnaire . 

.archive 

q . archive 
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> udd  >DRvC >N^\SA/RBZCN>NASA.  que  s t i onna  i r e >N\SA.  que  s t i onna  i r e . a r ch i ve 


updated  mode  modified  length 


name 

NASA.quest ionnaire.  JW,  runoff  03/21/84 
NASA. ques t i onna ire. cover . runof f 03/21/84 
NASA,  questi onna i re . runoff  04/02/84 
NASA. ques t i onna i re . JWl  i s t . runof  f 03/2 1/84 
NASA.ma i 1 ing_l  abe 1 s . a rchi ve  04/16/84 


1427.5 

r 

w 

03/21/84 

1041.1 

21015 

1427.5 

r 

w 

03/21/84 

1146.9 

39249 

2013.3 

r 

w 

04/02/84 

2012.8 

94086 

1427.5 

r 

w 

03/21/84 

1215.0 

15777 

0823.1 

r 

w 

04/16/84 

0111.5 

576504 

>udd>DBVB>NASA/RHICN>NASA.  ques  t i onna  i re  >QS1AI RE.  archive 


name 

updated 

mode 

modified 

1 ength 

data_entry_4>rogram.  pll  07/02/84 

1908.9 

rew 

07/02/84 

1906.2 

171864 

po  s t__p  r 0 c_of_d  a t a en  t 

ry__prog.pll  07/02/84 

1909.3 

rew 

07/02/84 

1906.2 

10260 

analys i s . spss 

07/02/84 

1912.3 

rew 

06/20/84 

0205.0 

50085 

pos  tj>roc__sps  soutput 

.pll  07/02/84 

1915.8 

rew 

07/02/84 

1853.3 

270225 

analysis _jnain.spss 

07/02/84 

1918.7 

rew 

07/02/84 

1906.4 

38169 

sunmary__of_resul  ts 

07/02/84 

2202.7 

rew 

07/02/84 

2202.7 

164718 

data__f  i le  or  Q 

07/02/84 

2203.8 

rew 

07/02/84 

2131.6 

160839 

ccmnent _J*i  le 

07/02/84 

2206.1 

rew 

07/02/84 

2040.9 

249246 

SLN-MARY . a r ch  i ve 

07/20/84 

1519.6 

r w 

07/20/84 

1512.2 

425844 

> udd >D0/B >NASA/RBOCN>NASA.  que s t i onna i re  > que s t i onna  i r expend i ng 
quota  = 0;  used  = 0 

Directory  empty:  >udd>DBMB>NASA/RBOCN>NASA.  ques  t i onna  i re  > ques  t i onnai  re_4>ending 
> udd  >D^tS > NASA/ RBCCN> NASA. ques  t i onna i r e > ques  t i onna i r e_da ta_analys  i s 
quota  = 0;  used  = 22 

quota  used 

0 0 

0 0 

0 1 

0 0 

0 0 

0 1 


directory  name 

specifications 
da  t a_en  t r y__p  r og  r ams 
spss__programs 
data 

da  ta^analys  i s__resul  t s 
Total 


Segments  = 5,  Lengths  = 21. 


rew  2 analysis_jnain.  spss 

rew  11  dat^L-files  .archive 

rew  5 data^entry_4)rogram.pl  1 

rew  1 NASA. quest^analys  is__tasks  . runoff 

t . runoff 
t 

rew  2 NASA.quest ionnaire_specs  . runof f 

s . runoff 
s 
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> udd  >DHsr^>N\SAyRKXN>N^\SA.  ques  t i onna  i r e > que  s t i onna  i r e_da  t a_ana  lys  i s >da  t a f lies  .archive 

updated  mode  modified  length 

ccmnent_file  05/25/84  0049.0  rew  05/24/84  1722.0  225234 

answer_file  05/30/84  1647.0  rew  05/30/84  1642.0  145854 

> udd>DEN^>N^SA/RHII>l>NASA.  quest  i onna  i re  > ques  t i onna  i re_da  t a__analys  is>specificati  ons 
quota  = 0;  used  = 0 

Di  rectory  empty : > udd>DHS/B>NASA/RBOCN>N\SA. quest! onnai  re > ques  t i onnai  r e_Jdaatiaij2aiBa lys i s > spe; 

> udd  >D0vE  >NASAyRHXN>N^SA.  ques  t i onna  ire>questi  onnai  re_da  ta ana  lys  i s >data entry  programs 

quota  = 0;  used  = 0 

Directory  enpty : > udd >DHvE>N^SA/RBCQ^>N\SA. quest  i onnai  re > ques  t i onnai  re  ntertyi  pgEia^ys  i s >dat;i 

> udd  >DHvB  >N^SA/RECCN>NASA.  ques  t i onna  i re  > ques  t i onna  i re_da  ta ana  lys  i s > sps  s programs 

quota  = 0;  used  = 1 

Segments  = 1,  Lengths  = 1. 

rew  1 exanpl  el . sps  s 

> udd>DEvC>NASA/RE0C14>N\SA.  quest  i onna  i re  > ques  t i onnai  re__da  ta_analys  i s >da  ta 
quota  = 0;  used  = 0 

Directory  empty:  > udd  >DHvB>N\SA/RBOCN>N\SA.  ques  ti  onnai  re>quest  i onnai  re_datcL_ana  lys  i s >dat 

> udd>D0s/B>N'\SA/RHXN>N\SA.  quest  i onnai  re  > ques  t i onnai  re_jda  ta__analys  i s >data_janalys  i s ^resul  t 

quota  = 0;  used  = 0 

Directory  enpty:  >udd>DFvB>N\SA/RBOCN>NASA.questionnai  re>questionnaire_a4all3as_fcm3dysis  >dat 

> udd  >DE^  >NASA/RBOCN>N\SA.  cour  s e__de  1 i ve  rabl  es 
quota  = 0;  used  = 83 


quota 

used 

di rectory  name 

0 

8 

standards 

0 

0 

syllabi 

0 

15 

vi sual  s_out 1 ines 

0 

114 

visuals 

0 

44 

lesson_plans 

0 

30 

hcmewo  r k^a  s s i gnmen  t s 

0 

18 

usage_ass  ignments 

0 

0 

examinations 

0 

93 

i ns  t r uc  1 0 r_jio  t e s 

0 

322 

Total 

Segs=0  s=0  ;Di  r s=9  ;LinJcs=0 . 

> udd >D0^>N^SA/RBOd^>N^SA. cour s e_jlel  iverables> standards 
quota  = 0;  used  = 8 

Segments  = 1,  Lengths  = 8. 

r w 8 N^SA.  course  . s tandards  . archive 
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s . archive 


> udd  >DHVE  >NASAyREOCN>NA.SA.  course_jiel  iverables>standards  >NASA,  cours  e . s tandards  .archive 


name 

updated 

mode 

modi f i ed 

1 eng  th 

NASA.CXJTLINES . specs  . runof  f 

08/01/84 

1912.2 

rew 

08/01/84 

1909.5 

56943 

NASA. VI SUALS  .specs,  runof  f 

08/01/84 

1931.5 

rew 

08/01/84 

1930.3 

105057 

NASA.CXJTLINES . r evi  ewing  . runof  f 

04/06/84 

2043.8 

rew 

04/06/84 

2043 . 8 

61317 

NASA.document__t en^lates . runoff 

08/01/84 

1706.3 

r w 

08/01/84 

1703.8 

56250 

> udd  >D0vE>N^SA/RBGCN>N^SA.  cour  s e_jlel  i ve rabl  e s > syl  1 abi 
quota  = 0;  used  = 0 

Directory  empty:  ^udd>D0vE>N\SA/RBOCN>N^SA.  course_del  iverabl  es  > syl  labi 
> udd >D0^>NASA/REOCN> NASA.  course_del  iverables>vi  sual s__out  lines 
quota  = 0;  used  = 15 

Segments  = 4,  Lengths  = 15. 

rew  1 NASA. SLNM^.CXJTLINES . runof  f 

rew  7 NASA.SUv^ER.OUTl-INES. archive 

so. archive 

rew  1 NASA. SIJNMER.OJTLINES.  runoff  .ec 

rw  6 NASA.CajRSE.OLTTLINES.archive 

0. archive 


>udd>DH^«>Na^SAyRBXN>N^. course_del iverables  >vi  sual s_outl  ines  >NASA. COURSE. OUTLINES,  arch 


name 

updated 

mode 

modi f i ed 

length 

NASA.  OUTLINES,  runoff,  ec 

05/18/84 

1228.0 

rew 

05/18/84 

1228.0 

1458 

NASA. OUTLINES . runoff 

05/09/84 

1416.9 

rew 

05/09/84 

1416.9 

10404 

NASA . 0 . FEATURE.JJ^N^ 

05/09/84 

1416.9 

rew 

05/09/84 

1416.9 

792 

NASA.O.  us  er_ca t egor i es . runof  f 

05/09/84 

1416.9 

rew 

05/09/84 

1416.9 

4590 

NASA.O.datauJWdels  . runoff 

05/09/84 

1416.9 

rew 

05/09/84 

1416.9 

2034 

NASA.O. logical . runoff 

05/09/84 

1416.9 

rew 

05/09/84 

1416.9 

2925 

NASA.O. physical  . runoff 

05/09/84 

1416.9 

rew 

05/09/84 

1416.9 

5481 

NASA.O. db_def  ini  t ion . runof f 

05/09/84 

1416.9 

rew 

05/09/84 

1416.9 

2466 

NASA.O. db_int  er  rogat  i on . runof  f 

05/09/84 

1416.9 

rew 

05/09/84 

1416.9 

7182 

NASA.O. db  report  gen. runoff 

05/09/84 

1416.9 

rew 

05/09/84 

1416.9 

3096 

NASA.O. db_japdate . runoff 

05/09/84 

1416.9 

rew 

05/09/84 

1416.9 

1899 

NASA.O. db__jedef  ini  t ion.  runoff 

05/09/84 

1416.9 

rew 

05/09/84 

1416.9 

1962 

NASA.O.  admin  i st  rat  ion.  runoff 

05/09/84 

1416.9 

rew 

05/09/84 

1416.9 

2718 

NASA.O.  db_securi  ty . runof  f 

05/09/84 

1416.9 

rew 

05/09/84 

1416.9 

3915 

NASA.O.  pme_jDvervi  ew.  runof  f 

05/09/84 

1416.9 

rew 

05/09/84 

1416.9 

6480 

NASA.O. BIBJ^BJ^ESIGN.  runoff 

05/09/84 

1416.9 

rew 

05/09/84 

1416.9 

477 

NASA.O. bib_db_des  ign.  runoff 

05/09/84 

1416.9 

rew 

05/09/84 

1416.9 

2916 

N^.O.BIE_FILEJSTRUCTURE.  runof  f05/09/84 

1416.9 

rew 

05/09/84 

1416.9 

459 

NASA.O.  linear,  runoff 

05/09/84 

1416.9 

rew 

05/09/84 

1416.9 

1818 

NASA.O.  1 i s t_s true tured.  runoff 

05/09/84 

1416.9 

rew 

05/09/84 

1416.9 

2430 

NASA.O.  clustered. runof  f 

05/09/84 

1416.9 

rew 

05/09/84 

1416.9 

2637 
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N^.0.\0O\BULARY_03^rTR(X.  runof f05/09/84 

1416.9 

r ew 

05/09/84 

1416.9 

369 

bt^SA.O.  controlled,  runoff 

05/09/84 

1416.9 

rew 

05/09/84 

1416.9 

1827 

N^^SA.O.  f ree_text . runoff 

05/09/84 

1416.9 

rew 

05/09/84 

1416.9 

1341 

N^A..O.  thesaurus  . runof  f 

05/09/84 

1416.9 

rew 

05/09/84 

1416.9 

4050 

NAS^.O.BIB _JSE4RO^IN3.  runoff 

05/09/84 

1416.9 

rew 

05/09/84 

1416.9 

504 

N^SA.0. 1 anguage_types  . runof  f 

05/09/84 

1416.9 

rew 

05/09/84 

1416.9 

9009 

N'^SA.O.  search_formulat ion.  runof f 05/09/ 84 

1416.9 

rew 

05/09/84 

1416.9 

20538 

N^SA.O. output  generation. runoff 

05/09/84 

1416.9 

rew 

05/09/84 

1416.9 

4707 

N^SA.O. ins  t rue t i on . runof  f 

05/09/84 

1416.9 

rew 

05/09/84 

1416.9 

7137 

N^lSA.O. APPLIG^TIOlJUyEAS . runof  f 

05/09/84 

1416.9 

rew 

05/09/84 

1416.9 

504 

NASA.O. sdi . runoff 

05/09/84 

1416.9 

rew 

05/09/84 

1416.9 

3708 

NASA.  0. per sonal_fi les . runof  f 

05/09/84 

1416.9 

rew 

05/09/84 

1416.9 

2241 

NASA.O.document_del  ivery.  runoff 

05/09/84 

1416.9 

rew 

05/09/84 

1416.9 

1917 

NASA.O.  IS&R_HvE.  runoff 

05/09/84 

1416.9 

rew 

05/09/84 

1416.9 

594 

NASA.O. ptne_J  ife_cycle.  runoff 

05/09/84 

1416.9 

rew 

05/09/84 

1416.9 

13590 

NASA.O. obt rus ive . runof  f 

05/09/84 

1416.9 

rew 

05/09/84 

1416.9 

9153 

NASA.O. unobtrusive . runof  f 

05/09/84 

1416.9 

rew 

05/09/84 

1416.9 

12474 

NASA.O. FUTURES,  runoff 

05/09/84 

1416.9 

rew 

05/09/84 

1416.9 

1962 

>udd>DEv^>N-^SA/RBOCN>NASA.course_deliverables> Vi  suals_out lines  >N^.SLM>'ER. OUTLINES. arch 


name 

updated 

mode 

modified 

length 

NASA.ClJrLINES . runof  f . ec 

08/05/84 

1742.8 

rew 

08/05/84 

1641.3 

1404 

N^SA.aJTLINES . runoff 

08/05/84 

1742.8 

rew 

08/05/84 

1637.5 

12906 

N^.O.  FEATURE_j^h^ 

05/09/84 

1416.9 

rew 

05/09/84 

1416.9 

792 

NASA.O,  us er_categori  es  . runoff 

05/09/84 

1416.9 

rew 

05/09/84 

1416.9 

4590 

NASA.O.  da  ta_mode  Is  . runoff 

05/09/84 

1416.9 

rew 

05/09/84 

1416.9 

2034 

NASA.O. logical. runoff 

05/09/84 

1416.9 

rew 

05/09/84 

1416.9 

2925 

NASA.O. phys i cal . runof  f 

05/09/84 

1416.9 

rew 

05/09/84 

1416.9 

5481 

NASA.O. db__def  ini  t ion.  runoff 

05/09/84 

1416.9 

rew 

05/09/84 

1416.9 

2466 

NASA.O. db_interrogat ion.  runof f 

05/09/84 

1416.9 

rew 

05/09/84 

1416.9 

7182 

NASA.O. db  report  gen. runoff 

05/09/84 

1416.9 

rew 

05/09/84 

1416.9 

3096 

NASA.O.  db__update  . runof  f 

05/09/84 

1416.9 

rew 

05/09/84 

1416.9 

1899 

NASA.O. db_redef  ini  t ion.  runoff 

05/09/84 

1416.9 

rew 

05/09/84 

1416.9 

1962 

NASA.O.  admin i st rat  ion.  runof  f 

05/09/84 

1416.9 

rew 

05/09/84 

1416.9 

2718 

NASA.O.  db__s  ecur  i ty.  runoff 

05/09/84 

1416.9 

rew 

05/09/84 

1416.9 

3915 

NASA.O.  pme_over  view,  runoff 

05/09/84 

1416.9 

rew 

05/09/84 

1416.9 

6480 

NASA.O. BIBJDBJDESICasT.  runoff 

05/09/84 

1416.9 

rew 

05/09/84 

1416.9 

477 

NASA.O.  bib_db_des  ign.  runof  f 

05/09/84 

1416.9 

rew 

05/09/84 

1416.9 

2916 

NASA.O. BIE_FILEJSTRUnURE.  runof  £05/09/84 

1416.9 

rew 

05/09/84 

1416.9 

459 

NASA.O. linear. runof  f 

05/09/84 

1416.9 

rew 

05/09/84 

1416.9 

1818 

NASA.O. 1 i st_s  true tured. runoff 

05/09/84 

1416.9 

rew 

05/09/84 

1416.9 

2430 

NASA.O.  clustered. runoff 

05/09/84 

1416.9 

rew 

05/09/84 

1416.9 

2637 

NASA.O.\OCABUlARY_CnvrrROL.  runof  £07/18/84 

1419.4 

rew 

07/18/84 

1150.4 

369 

NASA.O. controlled. runof  f 

07/18/84 

1419.4 

rew 

07/18/84 

1150.3 

1827 

NASA.O.  f ree_text . runoff 

05/09/84 

1416.9 

rew 

05/09/84 

1416.9 

1341 

NASA.O. thesaurus . runoff 

05/09/84 

1416.9 

rew 

05/09/84 

1416.9 

4050 

NASA . 0 . B I B>3EARCHING . r un  0 f f 

05/09/84 

1416.9 

rew 

05/09/84 

1416.9 

504 

NASA.O.  language__types  . runof  f 

05/09/84 

1416.9 

rew 

05/09/84 

1416.9 

9009 

NASA.O.  searclL-f  ormulat ion.  runof f 05/09/ 84 

1416.9 

rew 

05/09/84 

1416.9 

20538 

NASA.O. output_generat ion. runoff 

05/09/84 

1416.9 

rew 

05/09/84 

1416.9 

4707 
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N^SA.O. instruction. runoff 

05/09/84 

1416.9 

rew 

05/09/84 

1416.9 

7137 

N^.O.APPLICATIO^T ^AREAS . runoff 

05/09/84 

1416.9 

rew 

05/09/84 

1416.9 

504 

NASA.O. sdi . runof  f 

07/30/84 

1123.4 

r w 

07/30/84 

1107.2 

2952 

NASA.O.personal_/i  les  . runoff 

07/30/84 

1123.4 

r w 

07/30/84 

1110.0 

2385 

NASA.O.  documen t_de  livery,  runof  f 

07/30/84 

1123.4 

r w 

07/30/84 

1122.3 

2700 

NASA. 0. 1 S&RJME.  runof  f 

05/09/84 

1416.9 

rew 

05/09/84 

1416.9 

594 

NASA.O.  pme 1 i f e__cyc  1 e . runof  f 

05/09/84 

1416.9 

rew 

05/09/84 

1416.9 

13590 

NASA.O. obtrusive. runoff 

05/09/84 

1416.9 

rew 

05/09/84 

1416.9 

9153 

NASA.O. unobtrus ive . runoff 

05/09/84 

1416.9 

rew 

05/09/84 

1416.9 

12474 

NASA.O. FUTURES,  runoff 

08/05/84 

1742.8 

rew 

08/05/84 

1742.8 

639 

NASA.O.  INITROUCTICN.  runoff 

07/18/84 

1424.9 

rew 

07/18/84 

1154.0 

279 

NASA.O. convent i ona 1 . runof  f 

07/18/84 

1424.9 

rew 

07/18/84 

1157.0 

1269 

NASA.O.  ccmb__r e t . runof  f 

07/30/84 

1124.1 

r w 

07/30/84 

1113.2 

2016 

NASA.O. personal . runoff 

07/30/84 

1124.1 

r w 

07/30/84 

1116.1 

2484 

NASA.O.  fut_l  ang  . runof  f 

08/05/84 

1652.8 

r w 

08/05/84 

1642.4 

1566 

NASA.O.  a 1 t_user  . runof  f 

08/05/84 

1652.8 

r w 

08/05/84 

1645.1 

1566 

NASA.O.  PC_env.  runoff 

08/05/84 

1652.8 

r w 

08/05/84 

1649.1 

1575 

NASA.O. KBS . runof  f 

08/05/84 

1652.8 

r w 

08/05/84 

1652.3 

3078 

NASA.O.  di s t r i buted . runof  f 

08/05/84 

1652.8 

r w 

08/05/84 

1652.8 

1782 

NASA . SliVIvGl . OUTL INES  . r un  0 f f 

08/14/84 

0904 . 4 

rew 

08/14/84 

0904 . 4 

12942 

NASA.  SUvlvCR. OUTLINES . runof  f . ec 

08/11/84 

0900.4 

rew 

08/11/84 

0900 . 5 

1710 

NASA.O. introduction. runoff 

08/13/84 

1049.8 

r w 

08/13/84 

1049.8 

4059 

NASA.O. RESEAR(XJ^/FTH3DS . runof  f 

08/14/84 

0910.5 

r w 

08/14/84 

0910.5 

1440 

>udd>D0^>N^SA/RBXN>N^SA.  course_del  iverables>visuals 


quota 

= 0;  used  = 114 

Segments 

= 7,  Lengths  = 114. 

rew 

3 

NASA. HD. db  report  gen. runoff 

rew 

2 

NASA. HD.  in t roduc t i on . runof  f 

rew 

1 

NASA.SLM/ER.  runoff 

rew 

1 

NASA.  SLNMER . runof  f . ec 

rew 

8 

NASA . HAbCXXrrS . a r ch  i ve 

rew 

51 

NASA.  SLMv'ER .VISUALS .archive 
sv. archive 

r w 

48 

NASA.OCXJRSE.VI  SUALS  .archive 
V. archive 

> udd  >D0vB  >NASA/RBCCN>N\SA..  cour  s e_de  1 i ve  rabl  e s > vi  sua  1 s >N<\SA.aXIRSE . VI SUALS . a rch  i ve 


name 

updated 

mode 

mod i f i ed 

length 

NASA.VI SUALS . runoff  . ec 

05/14/84 

1825.2 

rew 

05/11/84 

1223.7 

1260 

NASA. VI SUALS.  runoff 

05/09/84 

1427.4 

rew 

05/09/84 

1427.4 

10404 

NASA.  V.  FEATUREJ^NALYS  I ^ 

05/21/84 

1241.4 

rew 

05/21/84 

1241.4 

3123 

NASA.V.user_ca  tegor  i es  . runof  f 

05/11/84 

1027.8 

rew 

05/11/84 

1027.8 

41490 

NASA.V.datzLjnodel  s . runoff 

05/09/84 

1427.4 

rew 

05/09/84 

1427.4 

91611 

NASA.V. logical . runof  f 

05/09/84 

1427.4 

rew 

05/09/84 

1427.4 

38295 

NASA.V.phys  i cal . runoff 

05/09/84 

1427.4 

rew 

05/09/84 

1427.4 

67185 

NASA.V. db_jief  ini  t i on . runof  f 

05/09/84 

1427.4 

rew 

05/09/84 

1427.4 

39528 

NASA.V. db_int er roga t i on . runof  f 

05/11/84 

1129.9 

rew 

05/11/84 

1129.9 

173421 

- 20  - 


N^^SA.V.db_repor  t_gen . runof  f 

05/09/84 

1427.4 

rew 

05/09/84 

1427.4 

50067 

N^SA.V.  db_upda  t e . runof  f 

05/11/84 

1133.2 

rew 

05/11/84 

1133.2 

20106 

N^A..V. db_redef  ini  t i on . runof  f 

05/11/84 

1142.2 

rew 

05/11/84 

1137.3 

12204 

N^SA.V.  admin  i st  rat  ion.  runoff 

05/11/84 

1142.2 

rew 

05/11/84 

1138.5 

18180 

N\SA.V.db__securi  ty . runof  f 

05/11/84 

1142.2 

rew 

05/11/84 

1139.8 

40446 

N^SA.V.  pme_overvi  ew.  runof  f 

05/09/84 

1427.4 

rew 

05/09/84 

1427.4 

62757 

N\SA.V.BIB_J)B_J)ESIGN.  runoff 

05/09/84 

1427.4 

rew 

05/09/84 

1427.4 

4905 

H\SA.V.  b i b_jdb__des  i gn . runof  f 

05/09/84 

1427.4 

rew 

05/09/84 

1427.4 

58959 

N^. V . B I B_p I LE_STRUCTURE . runof  f 05 /09 / 84 

1427.4 

rew 

05/09/84 

1427.4 

5526 

NASA.V.  linear,  runof  f 

05/09/84 

1427.4 

rew 

05/09/84 

1427.4 

21789 

NASA.V.  1 i s t__s  t rue  tured . runof  f 

05/09/84 

1427.4 

rew 

05/09/84 

1427.4 

33930 

N\SA.V. clustered. runof  f 

05/14/84 

1825.2 

rew 

05/14/84 

1825.2 

53613 

N^.V.\m^BUD\RY_(INrR(X.  runof  f05/09/84 

1427.4 

rew 

05/09/84 

1427.4 

3600 

N^^SA.V.  controlled,  runoff 

05/09/84 

1427.4 

rew 

05/09/84 

1427.4 

29835 

N^^SA.V.  f ree_text . runoff 

05/09/84 

1427.4 

rew 

05/09/84 

1427.4 

10188 

N^SA.V.  thesaurus . runoff 

05/11/84 

1156.3 

rew 

05/11/84 

1153.1 

40257 

N^.V.BIB^SEARCHING.  runoff 

05/21/84 

1246.5 

rew 

05/21/84 

1246.2 

2187 

N^SA^.V.  1 anguage__types  . runof  f 

05/11/84 

1206.2 

rew 

05/11/84 

1203.5 

254601 

N^SA.V. search-jformulat ion. runof f 05/1 1/84 

1206.2 

rew 

05/11/84 

1204.6 

147762 

NASA.V.  output_genera t i on . runof  f 

05/09/84 

1427.4 

rew 

05/09/84 

1427.4 

87273 

NASA.V. instruction. runoff 

05/11/84 

1206.2 

rew 

05/11/84 

1206.2 

16614 

MASA.V.APPLICATICN J\REAS . runof  f 

05/09/84 

1427.4 

rew 

05/09/84 

1427.4 

3762 

NASA.V.  sdi  . runoff 

05/09/84 

1427.4 

rew 

05/09/84 

1427.4 

7074 

NASA. V. personal __f  iles  .runoff 

05/09/84 

1427.4 

rew 

05/09/84 

1427.4 

4455 

NASA.V.document_jiel  i very . runof  f 

05/11/84 

1211.0 

rew 

05/11/84 

1209.3 

5004 

NASA.V.  ISaO^E.  runof  f 

05/21/84 

1251.5 

rew 

05/21/84 

1251.5 

2853 

NASA.V.pme_l  if  e_cycle  . runoff 

05/18/84 

1245.2 

rew 

05/18/84 

1245.0 

122409 

NASA.V. obt  rus i ve . runof  f 

05/11/84 

1211.0 

rew 

05/11/84 

1210.6 

52614 

NASA.V.  unobt  rus  i ve  . runof  f 

05/09/84 

1427.4 

rew 

05/09/84 

1427.4 

74376 

NASA.V. FUTURES,  runoff 

05/21/84 

1638.4 

rew 

05/21/84 

1638.5 

2961 

NASA.V.  sys  t enn^exampl  e . runof  f 

05/09/84 

1427.4 

rew 

05/09/84 

1427.4 

360 

NASA.V. di  scipl ^example  . runoff 

05/09/84 

1427.4 

rew 

05/09/84 

1427.4 

396 

>udd>D0v^>N^SAyREOCN>NASA.  course_del  iverables>visuals  >NASA.HANDXrrS  .archive 


name 

updated 

mode 

modified 

length 

sys  tems_Jiandout . runoff 

08/12/84 

0821.7 

r w 

08/12/84 

0821.7 

29538 

MAEiAvl.  pr  e_us  ag  e_que  s t i onna  i r e 

08/12/84 

0821.7 

rew 

08/12/84 

0821.7 

30771 

po  s t_jus  age_que  s t i onna  i r e 

08/12/84 

0821.7 

rew 

08/12/84 

0821.8 

57456 

intro_bandout . runoff 

08/12/84 

0821.7 

r w 

08/10/84 

1008.7 

25551 

NASA. HD.  intro_vi  sual . runoff 

08/13/84 

1004.4 

r w 

08/13/84 

0955.2 

25551 

NASA, HD.  pme_overvi  ev^^pre 

08/13/84 

1004.4 

rew 

08/13/84 

0955.2 

30771 

NASA. HD.  pme_jovervi  ew_j)os  t 

08/13/84 

1004.4 

rew 

08/13/84 

0955.2 

57456 

NASA. HD.  interrogation,  runoff 

08/13/84 

1004.4 

r w 

08/13/84 

0955.2 

29538 

>udd>D0vC>NASA/RBOCN>NASA.  course_del  iverables>visuals 

>N^.  SIM^ . VI SUALS . a r ch  i ■ 

name 

updated 

mode 

modi f i ed 

length 

NASA.V.  FEATIJRE^ANALYS  I S . runof f 

08/10/84 

1446.8 

rew 

08/10/84 

1446.8 

3159 

- 21 


NASA.V. user categories  .runoff 

08/10/84 

1451.2 

rew 

08/10/84 

1451.2 

35982 

NASA.V.data_models  . runoff 

08/10/84 

1501.8 

rew 

08/10/84 

1501.8 

54468 

NASA.V.  logical,  runoff 

08/10/84 

1505.7 

rew 

08/10/84 

1505.7 

21834 

NASA.V. phys i cal . runoff 

08/10/84 

1511.4 

rew 

08/10/84 

1511.4 

35478 

NASA.V. db_def  ini  t i on.  runof  f 

08/13/84 

1154.6 

rew 

08/13/84 

1154.6 

15750 

NASA.V.db_int er roga t ion . runof f 

08/13/84 

1158.0 

rew 

08/13/84 

1158.0 

139311 

NASA.V.  db_report_gen.  runoff 

08/10/84 

1645.6 

rew 

08/10/84 

1645.6 

58914 

NASA.V.  db^jupdate . runoff 

08/10/84 

1633.0 

rew 

08/10/84 

1633.0 

24075 

NASA.V. db__redef  ini  t ion.  runoff 

07/02/84 

1055.2 

rew 

07/02/84 

1055.0 

13383 

NASA.V.  admin i s t rat  i on . runof  f 

08/10/84 

2048.0 

rew 

08/10/84 

2048.0 

15102 

NASA.V.  db_se cur  i ty.  runoff 

08/10/84 

2044.9 

rew 

08/10/84 

2044.9 

36036 

NASA.V.  pme_overvi  ew.  runof  f 

08/10/84 

2143.3 

rew 

08/10/84 

2143.3 

55737 

NASA. V.Biaj3B_J)ESIC2Nl.  runoff 

07/02/84 

1055.2 

rew 

07/02/84 

1055.0 

4905 

NASA.V.  bib_db_de sign,  runoff 

08/10/84 

2225.9 

rew 

08/10/84 

2225.9 

51057 

NASA . V . B 1 I LEJSTRUCIURE . r uno f f 07 / 02 / 8 4 

1055.2 

rew 

07/02/84 

1055.0 

5526 

NASA.V.  1 inear . runoff 

08/14/84 

0852.6 

rew 

08/14/84 

0852.6 

22419 

NASA.V.  1 i s t s t rue  tured . runof  f 

08/11/84 

0919.3 

rew 

08/11/84 

0919.3 

27549 

NASA.V. clustered. runoff 

08/06/84 

1232.6 

rew 

07/31/84 

1959.3 

26946 

NASA . V . \OIABULARY_CCKrR(X . r u n 0 f f 0 7 / 2 0 / 8 4 

1345.7 

rew 

07/19/84 

1140.7 

3600 

NASA.V.  controlled,  runof  f 

08/11/84 

0938.5 

rew 

08/11/84 

0938.5 

33570 

NASA.V.  f ree_text . runoff 

08/11/84 

0942.1 

rew 

08/11/84 

0942.1 

12015 

NASA.V.  thesaurus  . runof  f 

08/11/84 

0952.4 

r w 

08/11/84 

0952.4 

40113 

NASA.V. BIB^SEAROflMj.  runoff 

08/11/84 

1759.8 

rew 

08/11/84 

1759.8 

2259 

NASA.V.  language types  . runof  f 

08/12/84 

0903.4 

rew 

08/12/84 

0903 . 4 

172134 

NASA.V.  searchLJforraulat ion.  runof f 08/ 12/ 84 

1650.1 

r w 

08/12/84 

1650.1 

137223 

NASA.V. output__generat  ion . runof f 

08/11/84 

0958.1 

rew 

08/11/84 

0958.1 

94932 

NASA.V.  instruction. runoff 

08/11/84 

1022.9 

rew 

08/11/84 

1022.9 

37971 

NASA.V.APPLICATICN jy^EAS.  runof  f 

08/14/84 

0858.5 

rew 

08/14/84 

0858.5 

4401 

NASA.V.  sdi  . runof  f 

08/11/84 

1045.9 

rew 

08/11/84 

1045.9 

14823 

NASA.V.  personal__fi  les  . runoff 

08/11/84 

1049.3 

rew 

08/11/84 

1049.3 

17397 

NASA.V.  document_del  ivery . runoff 

08/11/84 

1054.8 

rew 

08/11/84 

1054.8 

12699 

NASA.V.  IS&R.JME.  runof  f 

08/11/84 

1121  .5 

rew 

08/11/84 

1121.5 

2952 

NASA.V.  pme_l  i f e_cycle  . runoff 

08/11/84 

1241.4 

rew 

08/11/84 

1241.4 

91368 

NASA.V. obtrusive. runof  f . 

08/11/84 

1225.3 

rew 

08/11/84 

1225.3 

61326 

NASA.V.  unobtrus  ive  . runoff 

08/14/84 

0902.6 

rew 

08/14/84 

0902.6 

92340 

NASA.V. FUTURES,  runoff 

08/11/84 

1647.5 

rew 

08/11/84 

1647.5 

3060 

NASA.V.  sys  tem^example  . runoff 

08/06/84 

1240.2 

rew 

07/25/84 

1312.8 

360 

NASA.V.discipl_exanple.  runoff 

08/06/84 

1240.2 

rew 

07/25/84 

1312.1 

396 

NASA.V. futures . runoff 

07/21/84 

1031.3 

rew 

07/21/84 

1031.3 

108540 

NASA.V.  conventional . runoff 

08/10/84 

0925.6 

rew 

08/10/84 

0925.7 

35064 

NASA.V.  fut^lang  . runoff 

08/11/84 

1752.7 

re 

08/11/84 

1752.7 

28701 

NASA.V.  a 1 t_jLiser  . runoff 

08/11/84 

1721 .0 

re 

08/11/84 

1721.0 

24390 

NASA.V.  PC-^env.  runoff 

08/11/84 

1728.0 

r w 

08/11/84 

1728.0 

14940 

NASA.V. KBS.  runoff 

08/11/84 

1735.6 

r w 

08/11/84 

1735.6 

23130 

NASA.  V.distribu ted. runoff 

08/11/84 

1741.3 

r w 

08/11/84 

1741.3 

13554 

NASA.V. personal . runoff 

08/11/84 

1110.8 

rew 

08/11/84 

1110.8 

12816 

NASA.V.  comb_ret . runof  f 

08/11/84 

1101.6 

rew 

08/11/84 

1101.6 

11061 

NASA.  SIM/ER.  runof  f . ec 

08/12/84 

1049.4 

r w 

08/12/84 

1049.4 

1314 

NASA.  SLM^ER.  runoff 

08/14/84 

0849.9 

r w 

08/14/84 

0849.9 

13248 

NASA.V. introduction. runoff 

08/13/84 

1058.3 

rew 

08/13/84 

1058.1 

37368 

NASA.V.CXmSEJTv^VIBV.  runoff 

08/14/84 

0848.6 

r w 

08/14/84 

0848.6 

5139 

NASA.V. RESEARCHJvCmiDS . runof  f 

08/14/84 

0846.2 

r w 

08/14/84 

0846.2 

2592 

22  - 


> udd  >DBs/B>N^\SAyRBI)C>J>N^\SA.  course_de  liverables>l  es  soil4)1  ans 
quota  = 0;  used  = 44 


Segments  = 5,  Lengths  = 44. 


rew 

rew 

rew 

rew 

rew 


1 suzy . runout 
1 suzy. runoff 

1 1 es sorL4)l ans _Jieader  . runof  f 

22  1 es  sorL_pl  ans  . runout 

19  mSA.OJiMSE.LESSCtLJ^l^ 

1 .archive 


>udd>DHvB>N^SA/RBOCK>N^VSA.  cour se_del  i verables  > 1 es soiU-plans  >N\SA.(X)URSE.LESSC^LJ^LANS .arch 


name  updated  mode  modified  length 


1 essoruj)lans  . runoff 
lesson_plans_Jieader . runoff 
1 essorL4)lans_l . runoff 
lessoiu_plans__2.  runoff 
lessoix_plans_3-  runoff 
1 es soruplans_4 . runoff 
1 es  soiL4)lans__5 . runoff 
lesson^lans_6.  runoff 
les soiu.pl ans__7.  runoff 
lessorL4>lans_8 . runoff 
lesson_plans_9-  runoff 
lesson^lans__10.  runoff 
lessorL4)lans__ll . runoff 
1 es  sorupl  ans__12  . runof  f 
lessoiuplans__13A.  runoff 
lesson_plans_13B.  runoff 

lessoix^plans 14.  runoff 

1 es  soiupl ans_15  . runof  f 
lessorL_plans_16.  runoff 
lessoiL_plans__17 . runoff 
lessorL-plans__18 . runoff 
lesson^lans_19.  runoff 
less  oiup  1 ans_^0 . runof  f 
lesson_plans_J21 . runoff 
lessoi^lans_22 . runoff 
lessotL4>lans__23.  runoff 
lessorL_plans__24.  runoff 
lessoiuplans__25.  runof  f 
lessoruplans _26. runoff 
lessoix__plans^7 . runoff 
lesson_plans__28 . runoff 
1 es  soiL_plans_29 . runoff 
lessoruplans _30. runoff 
lessorL4)lans_JJl . runoff 
lessoiupians__32.  runoff 
lessoa_plans_33.  runoff 


05/07/84 

1645.3 

rew 

05/07/84 

1645.3 

rew 

05/07/84 

2045.4 

rew 

05/07/84 

2045.4 

rew 

05/07/84 

2045.4 

rew 

05/07/84 

2045 . 4 

rew 

05/07/84 

2045 . 4 

rew 

05/07/84 

2045.4 

rew 

05/07/84 

2045.4 

rew 

05/07/84 

2045 . 4 

rew 

05/07/84 

2045.4 

rew 

05/07/84 

2045 . 4 

rew 

05/07/84 

2045.4 

rew 

05/07/84 

2045.4 

rew 

05/07/84 

1905.4 

rew 

05/07/84 

2045.4 

rew 

05/07/84 

2045.4 

rew 

05/07/84 

2045.4 

rew 

05/07/84 

1725.9 

rew 

05/07/84 

2045.4 

rew 

05/07/84 

2045.4 

rew 

05/07/84 

2045.4 

rew 

05/07/84 

2045 . 4 

rew 

05/07/84 

2116.7 

rew 

05/07/84 

2116.7 

rew 

05/07/84 

2116.7 

rew 

05/07/84 

2116.7 

rew 

05/07/84 

2116.7 

rew 

05/07/84 

2116.7 

rew 

05/07/84 

2205.0 

rew 

05/07/84 

2205.0 

rew 

05/07/84 

2205.0 

rew 

05/07/84 

2205.0 

rew 

05/07/84 

2205.0 

rew 

05/07/84 

2205.0 

rew 

05/07/84 

2205.0 

rew 

05/07/84 

1639.3 

8433 

05/07/84 

1639.3 

23958 

05/07/84 

1923.5 

11673 

05/07/84 

1925.4 

11097 

05/07/84 

1929.2 

12978 

05/07/84 

1931.3 

11727 

05/07/84 

1936.5 

12303 

05/07/84 

1939.9 

12366 

05/07/84 

1954.0 

12042 

05/07/84 

2010.3 

12672 

05/07/84 

2009.8 

13734 

05/07/84 

2013.8 

9945 

05/07/84 

2016.5 

10944 

05/07/84 

2019.4 

10611 

05/07/84 

1836.6 

9441 

05/07/84 

2022 . 4 

11781 

05/07/84 

2024 . 8 

13284 

05/07/84 

2030.3 

14013 

05/07/84 

1725.6 

12654 

05/07/84 

2035 . 2 

12141 

05/07/84 

2040.0 

11151 

05/07/84 

2043.9 

13221 

05/07/84 

2045.4 

11313 

05/07/84 

2051.0 

15993 

05/07/84 

2053.7 

13257 

05/07/84 

2057.4 

15462 

05/07/84 

2100.5 

14580 

05/07/84 

2104.4 

17541 

05/07/84 

2107.5 

16803 

05/07/84 

2201 . 1 

14247 

05/07/84 

2200.8 

13014 

05/07/84 

2200.8 

14931 

05/07/84 

2200.8 

13752 

05/07/84 

2200.8 

15615 

05/07/84 

2200.8 

13500 

05/07/84 

2200.7 

12393 
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lessorL4>lans__34.  runoff 
1 es  sorx__pl  ans_35  . runof  f 
lessorL_plans_36.  runoff 
1 es  son_pl ans__37  . runof  f 
1 e s sorL_pl  ans__38  . runof  f 
1 es  son^l ans __39  . runof  f 
1 es soixj>l ans_40 . runof  f 
lesson_45lans_41 . runoff 
1 es son_pl ans_42 . runoff 
lesson__plans_43.  runoff 
1 es  son^lans__44 . runof  f 
lesson_plans_48 . runoff 


05/07/84 

2205.0 

rew 

05/07/84 

2205.0 

rew 

05/07/84 

2205.0 

rew 

05/07/84 

2205.0 

rew 

05/07/84 

2205.0 

rew 

05/07/84 

2205.0 

rew 

05/07/84 

2205.0 

rew 

05/07/84 

2205.0 

rew 

05/07/84 

2205.0 

rew 

05/07/84 

2205.0 

rew 

05/07/84 

2205.0 

rew 

05/07/84 

2205.0 

rew 

05/07/84 

2200.7 

13131 

05/07/84 

2200.7 

17955 

05/07/84 

2200.7 

16110 

05/07/84 

2200.7 

13104 

05/07/84 

2200.7 

11610 

05/07/84 

2200.7 

13896 

05/07/84 

2200.7 

13770 

05/07/84 

2200.7 

13518 

05/07/84 

2200.0 

13374 

05/07/84 

2159.7 

13779 

05/07/84 

2159.7 

13230 

05/07/84 

2156.5 

8604 

>udd>D0v4S>NASA/RBOCN>NASA.  course_jiel  ive rabies  >homework_as  s ignments 
quota  = 0;  used  = 30 


Segments  = 5,  Lengths  = 30. 


rew 

rew 

rew 

rew 

rew 


1 TESTl . runof  f 
3 q.new.  runoff 

7 NaniC.  archive 

11  hcmework.  archive 

8 NASA.COJRSE.H>e^C»K.  archive 


> udd  > DBVtS  >mSA/RJECOK>N\SA.  c ou r s e_d e 1 i ve  r ab  1 e s > hcmewD r k_a  s s i gnmen  t s >N\SAiGaJRSE  .H>B\ORK . 


name 

upda 

homework_l . runof  f 

05/07/84 

homeworlLJ . runof  f 

05/07/84 

hcmework-3 . runof  f 

05/07/84 

solut  i onJiw_l . runof  f 

05/07/84 

homewDrk_4 . runof  f 

05/07/84 

homework^ . runof  f 

05/07/84 

solut  ioiLj3w_2.  runoff 

05/07/84 

solut  ionJiW_3-  runoff 

05/07/84 

s 0 1 ut  i oilJ3W_4  . runof  f 

05/07/84 

solut  iorulis^^^.  runoff 

05/07/84 

homework,  runof  f 

05/07/84 

ted  mode  mod  i f i ed  1 eng  th 


1308.7 

r 

w 

05/07/84 

1044.9 

17478 

1308.7 

r 

w 

05/07/84 

0906 . 2 

17010 

0831.1 

r 

w 

05/07/84 

0829.7 

9333 

1308.7 

r 

w 

05/07/84 

1035.9 

75411 

1308.7 

r 

w 

05/07/84 

1229.0 

11898 

1308.7 

r 

w 

05/07/84 

0910.7 

7560 

1308.7 

r 

w 

05/07/84 

1116.9 

21456 

1308.7 

r 

w 

05/07/84 

1149.0 

45477 

1308.7 

r 

w 

05/07/84 

1228.0 

29529 

1308.7 

r 

w 

05/07/84 

1307.2 

21933 

1502.0 

rew 

05/07/84 

1501.9 

1809 

>udd>DHs/B>Nf^SA/RBOCK>N\SA.  cour se_del  i verabl  es  >hcmewDrk^as  s i gnments  >NanK.  archive 


name 

updated 

mode 

modi f i ed 

length 

usage_Jcey . runof  f 

08/06/84 

1329.3 

rew 

07/27/84 

0939.6 

135810 

usage . runoff 

08/06/84 

1329.8 

rew 

07/26/84 

1637.1 

55845 

N^SA^usage . runof  f 

08/06/84 

1330.1 

rew 

07/20/84 

0117.4 

26793 

>udd>D0vB>NASA/RBOCN>NASA.  cour  se_del  i verabl  es  >homewDrk^as  s i gnments  > homework,  archive 
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name 


updated 


mode 


modi f i ed 


length 


ql . runof  f 
q2 . runof  f 
q3 . runof  f 

q. standards . runoff 


08/14/84  1110.8  rew  08/14/84 
08/14/84  0836.9  rew  08/14/84 
08/14/84  0839.8  rew  08/14/84 
08/14/84  0838.8  rew  08/14/84 


1110.8  213129 

0836.9  104193 
0745.0  68139 
0745.0  9522 


>udd>DBvlS>NASA/RBCX14>N^SA.  cour  se_de  live  rabies  >usage_ass  ignment  s 
quota  = 0;  used  = 18 

Segments  = 5,  Lengths  = 18. 


rew  1 NASA—Usage . runof  f 

rew  2 usage. runoff 

rew  4 us age_Jtey.  runof f 

rew  7 NanrK.  archive 

rew  4 \ NASA. COURSE. USAGE^STS.  runoff 
ua . runof  f 

Spring_84.ua. runoff 


> udd  >DHvB  > NASA/ RBOCN>  NASA,  cour  se_de  1 iverables>  usage_a  s s i gnment  s >NarrK.  archive 


name 

Updated 

mode 

modified 

length 

usage_Jtey.  runoff 

08/06/84 

1329.3 

rew 

07/27/84 

0939.6 

135810 

usage . runof  f 

08/06/84 

1329.8 

rew 

07/26/84 

1637.1 

55845 

NAS^usage . runoff 

08/06/84 

1330.1 

rew 

07/20/84 

0117.4 

26793 

>udd>DHvC>NASA/RBCQ4>NASA.  cour  se_del  i ve  rabies  > examinat  i ons 
quota  = 0;  used  = 0 

Directory  enpty:  >udd>DHv^>NASA/RECCN>NASA.  course_del  iverables  > examinat  ions 
> udd >D0vE > NASA/ RBCCN> NASA. cour se_de  1 iverables>  inst rue tor_not es 
quota  = 0;  used  = 93 


Segments  = 8,  Lengths  = 89. 


rew 

6 

N^SA.  I .search^ormulation.  runoff 

rew 

4 

'NASA,  I .data^jnodel  s . runoff 

rew 

1 

N^SA.V.di  scipl_exart^le . runoff 

rew 

1 

NASA.V.  sys  t eni_exan5)l  e . runof  f 

rew 

1 

ISASA.  INSTRTXIOi.  runoff  . ec 

rew 

1 

N\SA.  INSTRUCTC*.  runoff 

rew 

1 

i . standards . runoff 

rew 

74 

NASA.(X)URSE.  INST31W^ 
INST,  archive 

>udd>D04S>NASA/RBOCN>NASA.  course_del  ive  rabies  > inst  rue  tor_notes  >NASA.  COURSE.  INSTLMANUAL 
nanie  updated  mode  modified  length 

NASA.VISUALS.runoff.ee  08/07/84  1529.9  rew  08/07/84  0949.0  1323 
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NASA.VISUALS.  runoff 

08/07/84 

1530.3 

rew 

08/07/84 

0949.0 

10935 

N\SA.  I 

. convent i onal . runof  f 

08/07/84 

1530.5 

rew 

08/07/84 

1530.5 

41022 

NASA.  I 

. introduction. runoff 

08/13/84 

0855.7 

rew 

08/13/84 

0855.7 

140436 

NASA.  1 

. FE\TURLAN^YS  I S . r un  o f f 

08/08/84 

0748.0 

rew 

08/08/84 

0748.0 

3087 

NASA.  I 

.use  r__ca  t egor  i es  . runof  f 

08/08/84 

0755.8 

rew 

08/08/84 

0755.8 

65979 

NASA.  I 

. data_jnodels  . runoff 

08/08/84 

0812.1 

rew 

08/08/84 

0810.2 

111087 

NASA.  I 

. logical . runoff 

08/08/84 

0939.6 

rew 

08/08/84 

0939.6 

35613 

NASA.  I 

. phys i cal . runoff 

08/09/84 

0810.8 

rew 

08/09/84 

0810.9 

87399 

NASA.  I 

. db_def ini t i on . runof  f 

08/13/84 

0912.0 

rew 

08/13/84 

0912.0 

35505 

NASA.  I 

.db_inter rogation. runoff 

08/13/84 

0944 . 3 

rew 

08/13/84 

0941.0 

265113 

NASA.  I 

. db__report__gen.  runoff 

08/13/84 

1058.8 

rew 

08/13/84 

1057.5 

143703 

NASA.  I 

. db_jLipda  t e . runof  f 

08/10/84 

0920.7 

rew 

08/10/84 

0920.7 

49986 

NASA.  I 

. db_redef ini t i on . runof  f 

08/08/84 

1716.4 

rew 

08/08/84 

1716.5 

40293 

NASA.  I 

. admin i s t ra t i on . runof  f 

08/08/84 

1718.1 

rew 

08/08/84 

1718.1 

77490 

NASA.  I 

. db_secur i ty . runoff 

08/09/84 

0704 . 1 

rew 

08/09/84 

0704.1 

34470 

NASA.  I 

. ptne_overview.  runoff 

08/08/84 

1632.5 

rew 

08/08/84 

1632.5 

91791 

NASA.  I 

.BIB_PB_J)ESIGN.  runoff 

08/08/84 

1634.6 

rew 

08/08/84 

1634.7 

4914 

NASA.  I 

. bib_db_design. runoff 

08/13/84 

1121 .0 

rew 

08/13/84 

1121.1 

69858 

NASA.  I 

.B1B_F1LE^TOUCTURE.  runof  f08/09/84 

0707.3 

rew 

08/07/84 

0949.1 

5526 

NASA.  I 

. 1 inear . runoff 

08/09/84 

0710.9 

rew 

08/09/84 

0710.9 

28602 

NASA.  I 

. 1 i s t_s  t rue  tured . runof  f 

08/09/84 

0722.2 

rew 

08/09/84 

0722.2 

29322 

NASA.  I 

.clustered. runof  f 

08/09/84 

0728.6 

rew 

08/09/84 

0728.6 

31392 

NASA.  I 

. \OIABUI^Y_(XNrRC)L . r un  0 f f 0 8 / 0 9 / 8 4 

0729.4 

rew 

08/07/84 

0949.1 

3600 

NASA.  I 

.controlled. runof  f 

08/09/84 

0740.0 

rew 

08/09/84 

0740.1 

41364 

NASA.  I 

. f ree__text . runoff 

08/09/84 

0743.4 

rew 

08/09/84 

0743.4 

14499 

NASA.  I 

. thesaurus . runoff 

08/09/84 

0752.2 

rew 

08/09/84 

0752.2 

48339 

NASA.  I 

.BIB_3EARCHING.  runoff 

08/09/84 

0755.4 

rew 

08/09/84 

0755.4 

2259 

NASA.  I 

. language_types . runoff 

08/13/84 

1650.4 

rew 

08/13/84 

1453.1 

212886 

NASA.  I 

. search.J'onnulat  ion.  runof  f 08/ 11/ 84 

1705.0 

rew 

08/11/84 

1705.0 

185526 

NASA.  I 

. output_generat i on . runof  f 

08/11/84 

1118.5 

rew 

08/11/84 

1118.6 

116370 

NASA.  I 

. ins  t rue t i on . runof  f 

08/10/84 

0645 . 7 

rew 

08/10/84 

0645.8 

48015 

NASA.  I 

.APPLICATICNJ\REAS.  runof  f 

08/10/84 

0657.7 

rew 

08/10/84 

0657.7 

4554 

NASA.  I 

. sdi . runof  f 

08/13/84 

1549.8 

rew 

08/13/84 

1549.9 

18891 

NASA.  I 

. persona  l_fi les . runoff 

08/13/84 

1554.7 

rew 

08/13/84 

1554.7 

32706 

NASA.  I 

. documen t__de  livery,  runof  f 

08/13/84 

1558.7 

rew 

08/13/84 

1558.8 

12699 

NASA.  I 

. runof  f 

08/13/84 

1601.9 

rew 

08/13/84 

1601.9 

2889 

NASA.  I 

• pcae_J.  i f e_cyc  1 e . runof  f 

08/13/84 

1650.0 

rew 

08/13/84 

1650.1 

139671 

NASA. I 

.obtrusive . runoff 

08/10/84 

1703.3 

rew 

08/10/84 

1703.3 

85851 

NASA.  I 

.unobtrus ive . runof  f 

08/13/84 

1702.0 

rew 

08/13/84 

1702.0 

129555 

NASA.  I 

. FUTURES . nmof  f 

08/13/84 

1706.1 

rew 

08/13/84 

1706.1 

3042 

NASA.  I 

. systenL_example . runoff 

07/31/84 

0856.8 

rew 

07/31/84 

0849.5 

360 

NASA.  I 

.di  scipl_exan^le . runoff 

07/31/84 

0857.0 

rew 

07/31/84 

0849.5 

396 

NASA.  I 

.mi}e_inf . runoff 

08/13/84 

1610.0 

rew 

08/13/84 

1610.0 

17415 

N^SA.V.  sys  t em_example  . runoff 

08/08/84 

0750.2 

rew 

08/07/84 

0949.3 

360 

N^SA.V.discipl_exan:5>le.  runoff 

08/08/84 

0750.4 

rew 

08/07/84 

0949.3 

396 

NASA.  I 

.futures . runoff 

08/13/84 

1722.3 

rew 

08/13/84 

1722.3 

133227 

NASA.  I 

.PC_env.  runof  f 

08/13/84 

1613.5 

rew 

08/13/84 

1613.5 

14940 

> udd  >D0vB>N^SA/RBOCN>N\SA.  proposal  s 
quota  = 0;  used  = 43 


quota  used 


directory  name 
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0 

10 

resumes 

0 

2 

specifications 

0 

12 

Total 

Segments  = 1,  Lengths  = 31. 

r w 31  NASA.  system_proposal . runout 

> udd  > NASA/ RBOCN>  NASA.  proposals>res  ume  s 

quota  = 0;  used  = 10 

Segments  = 7,  Lengths  = 10. 


rew  1 Gal  lagherivC.  resume  . runoff 

rew  2 KaviS.  resume  . runoff 

rew  2 Triantafyl lopoulosS. resum.  runoff 

rew  2 Ha  1 1 PP. resume  . runof f 

r w 0 NioreauCR.  resume  . runof  f 

rew  2 ChumPf.  resume  . runof  f 

r w 1 Grani  erivR.  resume  . runof  f 


> udd  >D^/B>NASA/RBOCN>NASA.  proposal  s >specifications 
quota  = 0;  used  = 2 

Segments  = 1,  Lengths  = 2. 

rw  2 NASA,  proposal  s . specs  . archive 
p. archive 


>udd>DHvE>NASA/RECCN>NASA.proposal  s >specifications  >NASA.  proposals  .specs 

03me  updated  mode  modified 

NASA. systems. revievL-specs. runoff 06/29/ 84  2057.4  rw  05/15/84  1628.5 

NASA. systems. 06/29/84. runoff  06/29/84  2059.0  rew  06/29/84  2058.6 

> udd  >D04S  >NASA/RBOCN>NASA.  PC . r&d 
quota  = 0;  used  = 8 

quota  used  directory  name 

0 2 specifications 

0 6 RBO^'Ls  tmu  1 a 1 0 r 


0 8 


Total 


Segs=Odv1sf  s=0;Di  rs=2  ;Links=0. 


> udd  >DHvB>  NASA/ RB0CN>  NASA.  PC.  r&d>  specifications 
quota  = 0;  used  = 2 


archive 

length 

28458 

42741 
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Segments  = 1,  Lengths  = 2, 

rew  2 NASA. PC.  spec  i f i ca t i ons  . a r chi ve 
s . archive 


> udd  >DBv^>  NASA/ RBOCN>  NASA.  PC.  r&d>  specifications  >N\SA.  PC.  specif  ications .archive 


name 

updated  mode 

mod i f i ed 

length 

NASA.  PC. specs. 06/06/84 . runof  f 
NASA.PC.C_sys__dev_s  tds  . runoff 

06/06/84 

07/12/84 

1710. 1 r w 
1244.5  r w 

06/06/84  1705.2 

07/12/84  1240.6 

30771 

28053 

>udd>D0v«>NASA/RBOCK>NASA.PC.  r&d>RBCX>L.s  imulator 
quota  = 0;  used  = 6 


Segments  = 1,  Lengths  = 6. 

rew  6 NASA.  PC_s  imul a t or  . specs  . runof  f 
s . runof  f 
s 
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ATTACHMENT  6.7 


USL  DBMS  NASA/RECON  BIBLIOGRAPHIC 
SUPPORT  DATA  BASE  STATUS 


USL  DBMS.NASA/RECON  MADAM  DATA  BASE  STATUS 


Logical  data  base  name 
Physical  data  base  path 
Date  Inversion 
Text  Inversion 
Standard  Stopword  List 
User  Stopword  List 
User  Keyword  List 
Comments  File 
Bulletin  File 
Thesaurus  File 
Macro  File 
Textual  Description 
Public/Private  File 
Data  Base  Administrator 
Number  of  Records 
Creation  Date 
Latest  Update 


: DBMS.NASA/RECON 
name  : >udd>DBMS>NASA/RECON>r&d 
: yes 
: yes 
: yes 
: no 
: no 
: yes 
: yes 
: no 
: yes 
: yes 
: private 
: ChumFY.DBMS 
: 55 

: 01/05/84 
: 04/22/84 


This  MADAM  database  **DBMS.NAS A/RECON”  contains  a full  citation  for 
the  reading  material  relevant  to  the  NASA/RECON  contract  work. 
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DBMS.NASA/RECON  OUTPUT  (08/01/84,  1716.44) 

********t******t*****************t*****tt****t**t*** 


REFERENCE  CODE:  1 

JOURNAL: 

DATE:  09/01/78 
TITLE: 

THE  NASA  SCIENTIFIC  AND  TECHNICAL  INFORMATION  SYSTEM  ITS  SCOPE  AND  COVERAGl 
AUTHOR(s): 

CHANDLER,  GEORGE  P.  JR. 

AFFILIATION: 

NASA  SCIENTIFIC  AND  TECHNICAL  INFORMATION  BRANCH 
ABSTRACT: 

the’  NASA  SCIENTIFIC  AND  TECHNICAL  INFORMATION  SYSTEM  HAS  BEEN  DEVELOPED  TC 
PROVIDE  NASA  AND  THE  AEROSPACE  COMMUNITY  WITH  THE  INFORMATION  TOOLS  TO 
ACCOMPLISH  THEIR  MISSIONS  IN  THE  MOST  EFFECTIVE  AND  EFFICIENT  MANNER. 

NASA’S  MISSION  ALSO  INCLUDES  THE  RESPONSIBILITY  OF  PROVIDING  MAXIMUM  USE 
OF  ACQUIRED  KNOWLEDGE  FOR  THE  BENEFIT  OF  ALL  MANKIND.  THE  SYSTEM  IS  A 
HIGHLY  AUTOMATED  ACTIVITY  THAT  NOT  ONLY  MEETS  THE  INFORMATION  REQUIREME> 
OF  NASA  AND  OTHERS  BUT  PROVIDES  ACCESS  TO  THE  MASSIVE  FLOW  OF  THIS  AND 
RELATED  INFORMATION  TO  OTHER  GOVERNMENT,  INDUSTRIAL  AND  ACADEMIC  GROUPS. 
THIS  PUBLICATION  LISTS  THE  SUBJECT  CRITERIA  APPLIED  TO  VARIOUS  DOCUMENTS 
TO  GOVERN  THE  DECISIONS  FOR  ACCEPTING  ADDITIONS  TO  THE  NASA  INFORMATION 
BANK.  IN  ADDITION  IT  ESTABILISHES  SUBJECT  GUIDANCE  FOR  THOSE  DESIRING  TO 
ADD  DOCUMENTS  TO  THE  COLLECTION  OR  TO  SEARCH  THE  COLLECTION  FOR  DOCUMENT 
OF  INTEREST  TO  MEET  THEIR  NEEDS. 

KEYWORDS: 

SUBJECT  CRITERIA  * SUBJECT  GUIDANCE  * SYSTEM  PURPOSE  • INFORMATION  TOOLS  » 
NASA  INFORMATION  SYSTEM 

CATEGORIES: 

1.52  * 3.1  * 3.2  * 3.7 

******************************************t******************************** 

REFERENCE  CODE:  2 

JOURNAL: 

INTERNATIONAL  AEROSPACE  ABSTRACTS 
VOLUME:  22 
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ISSUE:  20 

DATE:  10/15/82 


TITLE: 

INTERNATIONAL  AEROSPACE  ABSTRACTS 
AUTHOR(s): 

NATIONAL  AERONAUTICS  AND  SPACE  ADMINISTRATION 
AFFILIATION: 

TECHNICAL  INFORMATION  SERVICE  * AMERICAN  INSTITUTE  OF  AERONAUTICS  AND 
ASTRONAUTICS. 

ABSTRACT: 

INTERNATIONAL  AEROSPACE  ABSTRACTS  IS  AN  ABSTRACTING  AND  INDEXING  SERVICE 
COVERING  THE  WORLD’S  PUBLISHED  LITERATURE  IN  THE  FIELD  OF  AERONAUTICS, 
SPACE  SCIENCE  AND  TECHNOLOGY.  lAA  CONTAINS  THE  ABSTRACTS  SECTION  WITH  75 
SUBJECT  CATEGORIES  AND  THE  INDEX  SECTION  UNDER  5 INDICES.  LITERATURE 
COVERED  INCLUDES  PERIODICALS,  MEETING  PAPERS  AND  CONFERENCE  PROCEEDINGS 
AND  TRANSLATIONS  OF  JOURNALS  AND  ARTICLES.  A CUMMULATIVE  INDEX  APPEARS 
EACH  YEAR. 

KEYWORDS: 

INFORMATION  CLASSIFICATION  * AEROSPACE  ABSTRACTS  » INDEXING  * ABSTRACTS 

CATEGORIES: 

3.1  * 3.2  * 3.56 


REFERENCE  CODE:  3 

JOURNAL: 

STAR:  AN  ABSTRACT  JOURNAL 
VOLUME:  20 

ISSUE:  21 

DATE:  11/08/82 


TITLE: 

SCIENTIFIC  AND  TECHNICAL  AEROSPACE  REPORTS 
AUTHOR(s): 

NATIONAL  AERONAUTICS  AND  SPACE  ADMINISTRATION 
AFFILIATION: 

NATIONAL  AERONAUTICS  AND  SPACE  ADMINISTRATION 
ABSTRACT: 

SCIENTIFIC  AND  TECHNICAL  AEROSPACE  REPORTS  (STAR)  IS  A MAJOR  COMPONENT  OF 
A COMPREHENSIVE  NATIONAL  AERONAUTICS  AND  SPACE  ADMINISTRATION  INFORMATION 
SYSTEM  COVERING  AERONAUTICS,  SPACE  AND  SUPPORTING  DICIPLINES.  SUBJECT 
SCOPE  OF  STAR  INCLUDES  ALL  ASPECTS  OF  AERONAUTICS  AND  SPACE  RESEARCH  AND 
DEVELOPMENT,  SUPPORTING  BASIC  AND  APPLIED  RESEARCH  AND  APPLICATIONS. 


- 3 - 


KEYWORDS: 

SCIENTIFIC  AND  TECHNICAL  AEROSPACE  REPORTS  ♦ STAR  * ABSTRACTS  » SCIENTIFIC 
REPORTS 

CATEGORIES: 

3.1  * 3.2  * 3.5 


REFERENCE  CODE:  4 

JOURNAL: 

DATE:  09/09/83 
TITLE: 

NASA/RECON  USERS 
AUTHOR(s): 

NATIONAL  AERONAUTICS  AND  SPACE  ADMINISTRATION 
AFFILIATION: 

NATIONAL  AERONAUTICS  AND  SPACE  ADMINISTRATION 
ABSTRACT: 

THIS  ENTRY  LISTS  ALL  NASA/RECON  SYSTEM  USERS  AS  OF  09/09/83  SORTED- BY 
STATE  AND  CITY. 

KEYWORDS: 

NASA/RECON  USERS  ♦ SYSTEM  USERS 


REFERENCE  CODE:  5 

JOURNAL: 


TITLE: 

THE  NASA  INFORMATION  SYSTEM  AND  HOW  TO  USE  IT 
AUTHOR(s): 

NATIONAL  AERONAUTICS  AND  SPACE  ADMINISTRATION 
AFFILIATION: 

NATIONAL  AERONAUTICS  AND  SPACE  ADMINISTRATION 
ABSTRACT: 

THE  NASA  INFORMATION  SYSTEM  OFFERS  ACCESS  TO  A COMPUTERIZED  DATA  BASE 
CONTAINING  CITATIONS  OF  MORE  THAN  TWO  MILLION  DOCUMENTS  RELATED  TO 
AERONAUTICS  AND  SPACE.  IT  ALSO  PROVIDES  AUTOMATIC  REPORT  DISTIRBUTION, 
PRINTING  OF  RESEARCH  AND  DEVELOPMENT  RESULTS,  CONFERENCE  PROCEEDINGS  AND 
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OTHER  SPECIAL  PUBLICATIONS.  OTHER  SERVICES  INCLUDE  PREPARATION  OF 
TECHNICAL  TRANSLATIONS  AND  ANNOUNCEMENTS.  THROUGH  NASA/RECON,  AN  ONLINE 
INTERACTIVE  SYSTEM,  THE  PROGRAM  ALSO  PROVIDES  DIRECT  RAPID  RETRIEVAL  OF 
INFORMATION  FROM  THE  NASA  DATABASE.  THE  PROFILES  OF  THIS  GUIDE  DESCRIBE 
THE  SERVICES  AND  PRODUCTS  AVAILABLE  FROM  NASA.  EACH  PROFILE  IS  A COMPLETE 
DESCRIPTION  OF  THE  PRODUCT  OR  SERVICE  AVAILABLE. 

KEYWORDS: 

TECHNICAL  REPORTS  » SCIENTIFIC  REPORTS  * SYSTEM  PROFILES  * NASA/RECON 

CATEGORIES: 

3.1  » 3.2  * 3.5  * 3.7 


REFERENCE  CODE:  6 

JOURNAL: 


TITLE: 

NASA  STI-RECON  BULLETIN  AND  TECH  INFO  NEWS 
AUTHOR(s): 

NATIONAL  AERONAUTICS  AND  SPACE  ADMINISTRATION 
AFFILIATION: 

NATIONAL  AERONAUTICS  AND  SPACE  ADMINISTRATION 
ABSTRACT: 

NASA  STI-RECON  BULLETIN  AND  TECH  INFO  NEWS  IS  DISTIRBUTED  TO  ESTABILISHED 
USERS  TO  KEEP  THEM  INFORMED  ABOUT  NASA’S  SCIENTIFIC  AND  TECHNICAL 
INFORMATION  PRODUCTS  AND  SERVICES.  THIS  BULLETIN  IS  PUBLISHED  MONTHLY 

KEYWORDS: 

USER  SERVICES  * BULLETIN  * SYSTEM  UPDATES  * SYSTEM  NEWS 

CATEGORIES: 

3.5  * 3.7 


REFERENCE  CODE:  7 

JOURNAL: 


TITLE: 

NASA  RECON  USER’S  BULLETIN 
AUTHOR(s): 

NATIONAL  AERONAUTICS  AND  SPACE  ADMINISTRATION 
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AFFILIATION: 

NATIONAL  AERONAUTICS  AND  SPACE  ADMINISTRATION 
ABSTRACT: 

NASA  RECON  USER’S  BULLETIN  IS  DISTIRBUTED  TO  ESTABILISHED  RECON  USERS  TO 
KEEP  THEM  INFORMED  ABOUT  RECON  CHANGES,  ENHANCEMENTS,  POLICY,  CHARGING  AN 
OTHER  RECON  ASPECTS.  THIS  IS  A MONTHLY  PUBLICATION. 

KEYWORDS: 

USER  SERVICES  * SYSTEM  NEWS  * SYSTEM  UPDATES 

CATEGORIES:  i 

3.5  » 3.7 
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REFERENCE  CODE:  8 

JOURNAL: 

DATE:  01/05/80 
TITLE: 

NASA/RECON  SYSTEM  USER’S  MANUAL 
AUTHOR(s): 

NATIONAL  AERONAUTICS  AND  SPACE  ADMINISTRATION 
AFFILIATION: 

NATIONAL  AERONAUTICS  AND  SPACE  AND  SPACE  ADMINISTRATION 
ABSTRACT: 

NASA/RECON  IS  A COMPUTERIZED  SYSTEM  THAT  ENABLES  USERS  TO  CONDUCT  THEIR 
OWN  SEARCHES  THROUGH  A HUGE  LIBRARY  CATALOG  OF  TECHNICAL  PUBLICATIONS.  THI 
SYSTEM  CONSISTS  OF  A COMMUNICATIONS  NETWORK,  AN  INFORMATION  STORAGE  AND 
RETRIEVAL  FACILITY,  AND  A PROGRAMMED  COMPUTER  SYSTEM  WITH  A CENTRAL 
COMPUTER.  EACH  RECON  USER  CAN  ASK  THE  CENTRAL  COMPUTER  TO  LIST  THE 
CITATIONS  OF  DOCUMENTS  IN  THE  SYSTEM  LIBRARY  CATALOG  THAT  ARE  OF  INTEREST 
TO  HIM.  THE  SYSTEM  RESPONDS  BY  DISPLAYING  THE  ANSWERS  ON  THE  CATHODE  RAY 
TUBE  OR  BY  TYPING  IT  ON  A TELEPRINTER.  THE  INFORMATION  RETRIEVED  IS  IN  THE 
FORM  OF  CITATIONS  THAT  DESCRIBE  TECHNICAL  PUBLICATIONS.  A USER  CAN  SEARCH 
FOR  ARTICLES  OR  BOOKS  BY  DATE*  AUTHOR,  PUBLISHER,  OR  OTHER  CRITERIA.  A 
THESAURUS  CAN  RETRIEVE  CITATIONS  RELATED  TO  THE  SUBJECT.  THE  RECON  USER 
MANUAL  IS  DESIGNED  TO  SERVE  AS  A NONTECHNICAL  DESCRIPTION  AND  A PRIMER  TO 
INEXPERIENCED  USERS,  AS  WELL  AS  A REFERENCE  MANUAL  FOR  THE  EXPERIENCED 
USER.  IT  ALSO  INCLUDES  THE  RECON  COMMAND  LANGUAGE,  SEARCH  STRATEGY,  A 
DESCRIPTION  OF  USER  TERMINALS  AND  TELETYPES,  AND  AN  INDEX. 

KEYWORDS: 

NASA/RECON  * USER  MANUAL  * COMMAND  LANGUAGE  * INFORMATION  STORAGE  AND 
RETRIEVAL  * TERMINALS  » USER  GUIDE 

CATEGORIES: 
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1.1  * 2.4  * 3.5  * 3.7  * 3.8  * 4.33 
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REFERENCE  CODE:  9 

JOURNAL: 

DATE:  09/01/83 
TITLE: 

TIS  : AN  INTELLIGENT  GATEWAY  COMPUTER  FOR  INFORMATION  AND  MODELLING 
NETWORKS  OVERVIEW 

AUTHOR(s): 

HAMPEL,  VIKTOR  K. 

AFFILIATION: 

LAURENCE  LIVERMORE  NATIONAL  LABORATORY 
ABSTRACT: 

THE  TECHNOLOGY  INFORMATION  SYSTEM  (TIS)  IS  BEING  USED  TO  DEVELOP  SOFTWARE 
FOR  INTELLIGENT  GATEWAY  COMPUTERS  (IGC)  SUITABLE  FOR  THE  PROTOTYPING  OF 
ADVANCED,  INTEGRATED  INFORMATION  NETWORKS.  DEDICATED  TO  INFORMATION 
MANAGEMENT,  TIS  LEADS  THE  USER  TO  AVAILABLE  INFORMATION  RESOURCES,  ON  TIS 
OR  ELSEWHERE,  BY  MEANS  OF  A MASTER  DIRECTORY  AND  AUTOMATED  ACCESS 
PROCEDURES.  OTHER  GEOGRAPHICALLY  DISTIRBUTED  INFORMATION  SYSTEMS  ACCESSED 
THROUGH  TIS  INCLUDE  FEDERAL  AND  COMMERCIAL  SYSTEMS  LIKE  DOE/RECON, 
NASA/RECON,  DOD/DROLS,  DOT/TIC,  CIS,  AND  DIALOG  IN  THE  UNITED  STATES,  THE 
CHEMICAL  INFORMATION  SYSTEMS  DARC  IN  FRANCE  AND  DECHEMA  IN  WEST  GERMANY. 

KEYWORDS: 

TIS  * TECHNICAL  INFORMATION  SYSTEM  * NETWORK  SYSTEMS  * IGC  * INTELLIGENT 
GATEWAY  COMPUTERS  * NETWORK  PROTOTYPING 

CATEGORIES: 

3.1  » 3.2  * 3.5  » 3.7  » 3.81 
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REFERENCE  CODE:  10 

JOURNAL: 

DATE:  09/26/83 
TITLE: 

LOGIN  INSTRUCTIONS  FOR  TELENET  ACCESS 
AUTHOR(s): 

GENERAL  TELECOMMUNICATIONS  EQUIPMENT 
AFFILIATION: 
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GTE  TELENET  COMMUNICATIONS  CORPORATION 


ABSTRACT: 

THIS  ENTRY  CONTAINS  LOGIN  INSTRUCTIONS  FOR  TELENET.  ADDITIONAL  INFORMATION 
ABOUT  TELENET  AND  TELEMAIL,  TELENET’S  ELECTRONIC  MAIL  FACILITY  ARE 
PROVIDED. 

KEYWORDS: 

TELENET  ♦ LOGIN  » LOGIN  INSTRUCTIONS  * ELECTRONIC  MAIL 

CATEGORIES: 

2.43  » 3.57  * 3.8 
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REFERENCE  CODE:  11 

JOURNAL: 


VOLUME:  1 

DATE:  01/01/82 

TITLE: 

NASA  THESAURUS  VOLUME  1 - HIERARCHICAL  LISTINGS 


AUTHOR(s):  . , 

NATIONAL  AERONAUTICS  AND  SPACE  ADMINISTRATION 
AFFILIATION: 

NATIONAL  AERONAUTICS  AND  SPACE  ADMINISTRATION 
ABSTRACT: 

THE  NASA  THESAURUS  CONTAINS  THE  SUBJECT  TERMS  BY  WHICH  THE  DOCUMENTS  IN 
THE  NASA  INFORMATION  SYSTEM  ARE  INDEXED  AND  RETRIEVED.  THE  NASA  THESAURUS 
COMPRISES  TWO  VOLUMES:  VOLUME  1 FOR  THE  HIERARCHICAL  LISTINGS  AND  VOLUME 
2:  THE  ACCESS  VOCABULARY.  THE  LISTING  CONTAINS  POST  ABLE  AND  NON-POST  ABLE 
ITEMS.  INCLUDED  ARE  TERMS  APPEARING  IN  THE  NASA  THESAURUS  PRELIMINARY 
EDITION  (DECEMBER  1967),  NASA  THESAURUS  ALPHABETICAL  UPDATE  (SEPTEMBER 
1971),  THE  NASA  THESAURUS  (JANUARY  1976)  AND  OTHER  TERMS  APPEARING  THROUGH 
NOVEMBER,  1977. 

KEYWORDS: 

NASA  THESAURUS  • INFORMATION  STORAGE  AND  RETRIEVAL  » HIERARCHICAL  LISTINGS 

CATEGORIES: 

3.5  • 3.7  * 4.33 
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REFERENCE  CODE:  12 

JOURNAL: 
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VOLUME:  2 

DATE:  01/01/82 


TITLE: 

NASA  THESAURUS  VOLUME  2 - ACCESS  VOCABULARY 
AUTHOR(s): 

NATIONAL  AERONAUTICS  AND  SPACE  ADMINISTRATION 
AFFILIATION: 

NATIONAL  AERONAUTICS  AND  SPACE  ADMINISTRATION 
ABSTRACT: 

THE  ACCESS  VOCABULARY  IS  MADE  AVAILABLE  AS  A READY  REFERENCE  TOOL  TO 
PROVIDE  BETTER  ACCESS  TO  THE  NASA  THESAURUS  VOLUME  1,  HIERARCHICAL 
LISTING.  IT  UTILIZES  PSEUDO-TERMS  (PERMUTED  TERMS),  PSEUDO-MULTITERMS, 
OTHER  WORD  ENTRIES,  NONPOSTABLE  TERMS  (CROSS  REFERENCE)  AND  POSTABLE 
TERMS. 

KEYWORDS: 

NASA  THESAURUS  ♦ INFORMATION  STORAGE  AND  RETRIEVAL  * ACCESS  VOCABULARY 

CATEGORIES: 

3.5  * 3.7  * 4.33 


REFERENCE  CODE:  13 

JOURNAL: 

DATE:  01/07/82 
TITLE: 

COMBINED  FILE  POSTING  STATISTICS  BASED  ON  NASA  THESAURUS 
AUTHOR(s): 

NATIONAL  AERONAUTICS  AND  SPACE  ADMINISTRATION 
AFFILIATION: 

NATIONAL  AERONAUTICS  AND  SPACE  ADMINISTRATION 
ABSTRACT: 

THIS  ALPHABETICAL  LISTING  OF  POSTABLE  SUBJECT  TERMS  CONTAINED  IN  THE  NASA 
THESAURUS  IS  USED  TO  DISPLAY  THE  NUMBER  OF  POSTINGS  (DOCUMENTS)  INDEXED  BY 
EACH  SUBJECT  TERM  FROM  1968  TO  DATE.  THE  POSTING  TOTALS  PER  TERM  ARE 
SEPARATED  BY  ANNOUNCEMENT  OR  OTHER  MEDIA  INTO  STAR,  lAA,  CSTAR,  AND  OTHER 
COLUMNAR  ENTRIES  COVERING  THE  NASA  DOCUMENT  COLLECTION. 

KEYWORDS: 

FILE  STATISTICS  » INFORMATION  STORAGE  AND  RETRIEVAL  * PERFORMANCE 
MEASURMENT  AND  EVALUATION  » NASA  THESAURUS 
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CATEGORIES: 
3.51  * 3,7  * 4.6 
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REFERENCE  CODE:  14 

JOURNAL: 

DATE:  09/01/82 
TITLE: 

CORPORATE  SOURCE  AUTHORITY  LIST 
AUTHOR(s): 

NATIONAL  AERONAUTICS  AND  SPACE  ADMINISTRATION 
AFFILIATION: 

NATIONAL  AERONAUTICS  AND  SPACE  ADMINISTRATION 
ABSTRACT: 

THE  LISTED  CORPORATE  SOURCES  HAVE  BEEN  APPROVED  FOR.  USE  IN  THE  CUMMULATIV] 
INDEXES  TO  THE  NASA  ABSTRACT  JOURNALS.  THE  CODED  TERMS  ARE  USED  IN 
COMPLETING  THE  DOCUMENT  PROCESSING  FORMS  OR  APPROVED  SUBSTITUTE  FORMS. 
THESE  ABRIDGED  ENTRIES  HAVE  BEEN  DEVELOPED  FROM  THE  FULL  CORPORATE  AUTHOR 
THAT  APPEAR  IN  THE  CITATIONS  USED  IN  THE  ABSTRACT  SECTION. 

KEYWORDS: 

ABSTRACT  JOURNALS  * INFORMATION  SOURCES  * AUTHORITY  LIST 

CATEGORIES: 

3.5  * 3.7 
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REFERENCE  CODE:  15 

JOURNAL: 

DATE:  09/01/83 
TITLE: 

CORPORATE  SOURCE  AUTHORITY  LIST 
AUTHOR(s): 

NATIONAL  AERONAUTICS  AND  SPACE  ADMINISTRATION 
AFFILIATION: 

NATIONAL  AERONAUTICS  AND  SPACE  ADMINISTRATION 
ABSTRACT: 

THE  LISTED  CORPORATE  SOURCES  HAVE  BEEN  APPROVED  FOR  USE  IN  THE  CUMMULATIV 
INDEXES  TO  THE  NASA  ABTRACT  JOURNALS.  THE  CODED  TERMS  ARE  USED  IN 
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COMPLETING  THE  DOCUMENT  PROCESSING  FORMS  OR  APPROVED  SUBSTITUTE  FORMS. 
THESE  ABRIDGED  ENTRIES  HAVE  BEEN  DEVELOPED  FROM  THE  FULL  CORPORATE  AUTHOR 
THAT  APPEAR  IN  THE  CITATIONS  USED  IN  THE  ABSTRACT  SECTION. 

KEYWORDS: 

ABSTRACT  JOURNALS  * INFORMATION  SOURCES  * AUTHORITY  LIST 

CATEGORIES: 

3.5  » 3.7 


***********tt***********t*******************t%ttt%tt***************t*ttt*** 


REFERENCE  CODE:  16 

JOURNAL: 


TITLE: 

THE  CHEMICAL  SUBSTANCES  INFORMATION  NETWORK 
AUTHOR(s): 

CHEMICAL  SUBSTANCES  INFORMATION  NETWORK 
AFFILIATION: 

CHEMICAL  SUBSTANCES  INFORMATION  NETWORK 
ABSTRACT: 

THE  CHEMICAL  SUBSTANCES  INFORMATION  NETWORK  (CSIN)  IS  A NETWORK  OF 
COORDINATED  ONLINE  INFORMATION  SYSTEMS  CONCERNING  CHEMICAL  SUBSTANCES.  ITS 
PURPOSE  IS  TO  SATISFY  THE  INFORMATION  REQUIREMENTS  OF  TOXIC  SUBSTANCES 
LEGISLATION  AND  A BROAD  SPECTRUM  OF  RELATED  ACTIVITIES.  THE  CHEMICAL 
SUBSTANCES  INFORMATION  NETWORK  PROVIDES  INFORMATION  ON  NOMENCLATURE  AND 
COMPOSITION,  PROPERTIES,  PRODUCTION  AND  COMMERCE,  PRODUCTS  AND  USES, 
EXPOSURE,  EFFECTS,  STUDIES  AND  RESEARCH  AND  REGULATIONS  AND  CONTROLS  OF 
CHEMICAL  SUBSTANCES. 

KEYWORDS: 

CSIN  * CHEMICAL  SUBSTANCES  INFORMATION  NETWORK  * INFORMATION  NETWORKS  » 
CHEMICAL  INFORMATION  * CHEMISTRY  ♦ CHEMICAL  SUBSTANCES 

CATEGORIES: 

3.12  • 3.13  * 3.22  * 3.33  » 3.54  * 3.7 
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REFERENCE  CODE:  17 

JOURNAL: 

VOLUME:  1 

TITLE: 

AN  ANALYSIS  OF  REQUIREMENTS  FOR  THE  CHEMICAL  SUBSTANCES  INFORMATION  NETWC 
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AUTHOR(s): 

WILSON  GERALD  A.  * BARNET  JANE  E.  * MARKS  BENNET  D.  * KULP  CAROL  S 
AFFILIATION: 

COMPUTER  CORPORATION  OF  AMERICA 
ABSTRACT: 

A MAJOR  CONCLUSION  FROM  THIS  ANALYSIS  IS  THAT  THERE  IS  NO  APPROPRIATE 
CONNECTION  BETWEEN  USER’S  INFORMATION  NEEDS  AND  EXISTING  INFORMATION 
TOOLS.  INDIVIDUAL  DATABASES  DO  NOT  IN  GENERAL  PROVIDE  ALL  THE  REQUIRED 
DATA;  THUS  USERS  FIRST  HAVE  TO  FIRST  LOCATE  AND  THEN  SEARCH  THROUGH 
POTENTIALLY  MANY  DATABASES  TO  INSURE  A PROPER  TREATMENT  OF  A SUBJECT.  OF 
ALL  THE  CHEMICAL  INFORMATION  NEEDS,  THE  MOST  PRESSING  IS  THE  NEED  TO  MORE 
EFFECTIVELY  INTEGRATE  AND  ACCESS  THE  INFORMATION  THAT  IS  ALREADY 
AVAILABLE.  EXISTING  INFORMATION  SYSTEMS  DO  NOT  LEND  THEMSELVES  TO 
INFORMATION  SEARCHES  OF  THE  NESSECARY  BROAD  NATURE.  THE  SURVEYED  COMMUNn 
BELIEVES  THERE  IS  A GREAT  NEED  FOR  AN  INFORMATION  SYSTEM  THAT  WOULD  PERMi: 
THEM  TO  PERFORM  SEARCHES  AND  DATA  INTEGRATION  WITHOUT  REQUIRING  DIRECT  US 
OF  MANY  DIFFERENT  SYSTEMS.  SO  EFFECTIVE  COORDINATION  OF  EXISTING 
INFORMATION  SYSTEMS  MUST  BE  OBTAINED. 

KEYWORDS: 

CSIN  » CHEMICAL  SUBSTANCES  INFORMATION  SYSTEM  * INFORMATION  NETWORKS  * 
CHEMICAL  INFORMATION  * CHEMISTRY  * CHEMICAL  SUBSTANCES  * REQUIREMENTS 
ANALYSIS  OF  INFORMATION  SYSTEMS 

CATEGORIES: 

3.12  * 3.13  * 3.22  » 3.33  » 3.54  * 3.7 


REFERENCE  CODE:  18 

JOURNAL: 


TITLE: 

CURRENT  CSIN  CAPABILITIES 
AUTHOR(s): 

NATIONAL  AERONAUTICS  AND  SPACE  ADMINISTRATION 
AFFILIATION: 

NATIONAL  AERONAUTICS  AND  SPACE  ADMINISTRATION 
ABSTRACT: 

CSIN  - THE  CHEMICAL  SUBSTANCES  INFORMATION  NETWORK  - IS  A POWERFUL 
NETWORKING  TOOL  DESIGNED  TO:  SPEED  ACCESS  TO  A WIDE  SPECTRUM  OF  CHEMICAL 
AND  NON-CHEMICAL  DATA  BASES;  COORDINATE  SEARCHES  IN  THESE  DATABASES; 
REDUCE  ERRORS:  COLLECT  AND  EDIT  SEARCH  DATA  IN  THE  REQUESTED  OUTPUT 
FORMAT;  REDUCE  SEARCH  TIME  FOR  REPETITIOUS  SEARCHES;  PERMIT  SEARCHERS  WITH 
A WIDE  VARIETY  OF  BACKGROUND  TO  PERFORM  SEARCHES.  CSIN  PROVIDES  THREE 
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DIFFERENT  SEARCH  MODES.  IN  ADDITION,  CSIN  PROVIDES  A VARIETY  OF  UTILITIES 
TO  SUPPORT  SEARCHES  AND  PERMIT  USER  CUSTOMIZATION.  CSIN  ALSO  ALLOWS  USERS 
TO  SHARE  INFORMATION  AND  SEARCH  STRATEGIES  WITHIN  A DEFINED  SEARCH  GROUP. 

KEYWORDS: 

CSIN  * CHEMICAL  SUBSTANCES  INFORMATION  NETWORK  * CHEMICAL  INFORMATION 
SYSTEMS  » INFORMATION  STORAGE  AND  RETRIEVAL  » INFORMATION  NETWORKS  * DATA 
BASE  MANAGEMENT  SYSTEMS  * 

CATEGORIES: 

3.13  * 3.12  * 3.22  * 3.7  * 4.33 
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REFERENCE  CODE:  19 

JOURNAL: 


TITLE: 

PLAN  FOR  AN  EVALUATION  OF  THE  CSIN  PROTOTYPE 
AUTHOR(s): 

BOLK  BERANAK  AND  NEWMAN,  INC. 

AFFILIATION: 

BOLK  BERANAK  AND  NEWMAN,  INC. 

ABSTRACT: 

THE  DEVELOPMENT  OF  A COMPLEX  PROJECT  LIKE  CSIN  REQUIRES  PERIODIC 
EVALUATION.  THE  MODULAR  DESIGN  AND  IMPLEMENTATION  PLAN  OF  CSIN  OFFERS 
CONVENIENT  PLACES  WITHIN  THE  PLAN  FOR  EVALUATION  AND  RESSESEMENT.  THESE 
AREAS  INCLUDE  ASSESEMENT  OF  SYSTEM  PERFORMANCE,  ASSESEMENTS  OF  SYSTEM 
USABILITY,  DETERMINATION  OF  SYSTEM  IMPACT,  AND  FUTURE  PLANNING.  THE 
EVALUATION  AUDIENCE  INCLUDES  SPONSORING  ORGANIZATIONS,  POTENTIAL 
SPECIALIST/NONSPECIALIST  USERS,  PARTICIPATING  AND  POTENTIAL  DATABASE 
SYSTEMS,  AND  SYSTEM  R&D  STAFF.  INFORMATION  NEEDED  DURING  THE  CYCLE  WILL 
COME  FROM  POTENTIAL  AND  ACTUAL  USERS,  PROJECT  SPONSORS,  SYSTEM  DEVELOPERS, 
THE  USERS  SERVICE  OFFICE  AND  OTHERS.  THE  METHODOLOGIES  AVAILABLE  FOR 
INFORMATION  COLLECTION  CAN  INCLUDE  ROUTINE  SYSTEM  DATA  COLLECTION, 
ACCOUNTING  FILES,  USER  LOG/TRAIL  FILES,  UP/DOWNTIME  LOGS,  USER  SERVICE 
RECORDS,  SYSTEM  EXPERIMENTS,  USER  PRODUCTIVITY  STUDIES,  AND  SYSTEM 
PERFORMANCE  STUDIES.  USER  SURVEYS  AND  QUESTIONNAIRES  (REGULAR  AND  ON-LINE) 
CAN  ALSO  BE  USED.  INCLUDED  IS  ALSO  A REPORT  OF  THE  SYSTEM  PERFORMANCE 
EVALUATION  METHODOLOGY  TO  BE  FOLLOWED.  ANALYSIS  OF  DATA,  AND  A TIMETABLE 
OF  THE  PROCEEDINGS  ARE  NESSECARY  FOR  THE  CORRECT  ANALYSIS  AND  ARE  ALSO 
INCLUDED. 

KEYWORDS: 

CSIN  » CHEMICAL  SUBSTANCES  INFORMATION  NETWORK  » CHEMICAL  INFORMATION 
SYSTEMS  » PERFORMANCE  MEASUREMENT  AND  EVALUATION  » INFORMATION  NETWORKi 
DATA  BASE  MANAGEMENT  SYSTEMS 
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CATEGORIES: 

3.13  » 3.12  * 3.22  * 3.72  * 4.33 
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REFERENCE  CODE:  20 

JOURNAL: 


TITLE: 

PROCEEDINGS  OF  THE  WORKSHOP  ON  DATA  QUALITY  INDICATORS 
AUTHOR(s): 

CHEMICAL  MANUFACTURERS  ASSOCIATION 
AFFILIATION: 

CHEMICAL  MANUFACTURERS  ASSOCIATION 
ABSTRACT: 

DATA  QUALITY  INDICATORS  ARE  FEASIBLE  AND  SUCH  INDICATORS  ARE  NEEDED  IN 
COMPUTERIZED  DATA  BASES.  DATA  QUALITY  INDICATORS  SHOULD  CONTAIN 
INFORMATION  ABOUT  FOUR  DISTINCT  ELEMENTS:  THE  METHOD  TO  OBTAIN  THE  DATA, 
THE  EXTENT  TO  WHICH  THE  DATA  HAVE  BEEN  EVALUATED,  THE  DATA  SOURCE  AND  AF 
INDICATION  OF  DATA  ACCURACY.  THESE  INDICATORS  SHOULD  PROVIDE  THE  USER  WITH 
ENOUGH  INFORMATION  TO  DETERMINE  THE  UTILITY  AND  SUITABILITY  OF  THE  DATA 
FOR  SPECIFIC  USES.  AT  A MINIMUM  SUCH  INDICATORS  COULD  IDENTIFY  WHERE  THE 
USER  COULD  OBTAIN  OR  DERIVE  THIS  INFORMATION. 

KEYWORDS: 

CHEMICAL  INFORMATION  SYSTEMS  * INFORMATION  STORAGE  AND  RETRIEVAL  » 
INFORMATION  NETWORKS  » DATA  BASE  MANAGEMENT  SYSTEMS 

CATEGORIES: 

3.13  » 3.12  * 3.22  * 3.72  * 4.33 

REFERENCE  CODE:  21 

JOURNAL: 

DATE:  01/16/84 
TITLE: 

CMPS669  NASA/RECON  HANDOUTS 
AUTHOR(s): 

DOMINICK,  WAYNE  D. 

AFFILIATION: 

UNIVERSITY  OF  SOUTHWESTERN  LOUISIANA 
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ABSTRACT: 

THIS  SERIES  OF  HANDOUTS  INCLUDES  THE  FOLLOWING:  CMPS669  SYLLABUS,  THE 
NASA/RECON  COURSE  DEVELOPEMENT,  ADMINISTRATION  AND  EVALUATION  PROPOSAL, 
THE  CMPS669  NASA/RECON  COURSE  CONTENTS  OUTLINE,  AND  VARIOUS  NASA/RECON 
MEETING  AGENDAS  AND  NOTES. 

♦♦♦*♦♦**♦****♦*****♦**»♦»*»»»♦»*♦*»**»»***»**♦♦»*»»♦»♦***♦**♦*♦»*♦»♦♦»*♦•«** 


REFERENCE  CODE:  22 

JOURNAL: 

DATE:  01/16/84 
TITLE: 

CMPS669  NASA/RECON  POTENTIAL  FOILS 


AUTHOR(s): 

DOMINICK,  WAYNE  D. 

AFFILIATION: 

UNIVERSITY  OF  SOUTHWESTERN  LOUISIANA 
ABSTRACT: 

THIS  SERIES  OF  FOILS  FOR  POTENTIAL  USE  WITHIN  THE  NASA/RECON  CONTRACT  WORK 
INCLUDES  THE  FOLLOWING:  INTRODUCTION,  DBMS,  IS&R  FEATURE  ANALYSIS  SUMMARY, 
COMPARISON,  MIS/DSS  META-BASE,  GUIDE/SHARE,  CODASYL,  RELATIONAL,  DB 
DESIGN,  LOGICAL,  PHYSICAL,  IS&R  FILE  ORGANIZATIONS,  CLUSTERING, 

VOCABULARY,  INDEXING,  LANGUAGES,  HUMAN  FACTORS,  IS&R  SYSTEMS, 

APPLICATIONS,  INSTRUCTION,  IS&R  PME,  TRADITIONAL,  AUTOMATED,  LIFE  CYCLE, 
INTERFACES,  DISTIRBUTED  ENVIRONMENTS,  AND  FUTURES. 

*************************************************************************** 


REFERENCE  CODE:  23 

JOURNAL: 

DATE:  12/31/80 
TITLE: 

INDEX  TO  NASA/RECON  USER’S  BULLETIN 
AUTHOR(s): 

NATIONAL  AERONAUTICS  AND  SPACE  ADMINISTRATION 
AFFILIATION: 

NASA  SCIENTIFIC  AND  TECHNICAL  INFORMATION  BRANCH  * NATIONAL  AERONAUTICS 
AND  SPACE  ADMINISTRATION 

ABSTRACT: 

THIS  PUBLICATION  CONTAINS  AN  INDEX  TO  THE  NASA/RECON  USER’S  BULLETIN.  THE 
DATES  INCLUDED  IN  THE  INDEX  ARE  01/01/79  THROUGH  12/31/80.  ALSO, 
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ADDITIONAL  COPIES  OF  THE  USER’S  BULLETIN  ARE  INCLUDED.  INDEXING  IS  DONE 
THROUGH  TITLE  OR  SUBJECT. 

KEYWORDS: 

SUBJECTS  * SUBJECT  INDEX  * NASA/RECON  USER’S  BULLETIN  * NASA  INFORMATION 
SYSTEM  * NASA/RECON 


REFERENCE  CODE:  24 

JOURNAL: 

DATE:  01/14/84 
TITLE: 

NASA  - STI  FACILITY  ANNOUNCEMENTS 
AUTHOR(s): 

NATIONAL  AERONAUTICS  AND  SPACE  ADMINISTRATION 
AFFILIATION: 

NASA  SCIENTIFIC  AND  TECHNICAL  INFORMATION  BRANCH  * NATIONAL  AERONAUTICS 
AND  SPACE  ADMINISTRATION 

ABSTRACT: 

THIS  ENTRY  CONTAINS  VARIOUS  ANNOUNCEMENTS  SENT  BY  THE  NASA  SCIENTIFIC  AND 
TECHNICAL  INFORMATION  FACILITY.  THESE  ANNOUNCEMENTS  ARE  IN  ADDITION  OF  THE 
NEWSLETTERS  AND  CONTAIN  INFORMATION  ABOUT  THE  NASA  STI  FACILITY. 

KEYWORDS: 

NASA  INFORMATION  SYSTEM  • NASA/RECON  * SCIENTIFIC  AND  TECHNICAL  FACILITY 


REFERENCE  CODE:  25 

JOURNAL: 

DATE:  01/14/84 
TITLE: 

NASA  - PERSONAL  COMPUTERS  ANALYSIS  AND  EVALUATION 
AUTHOR(s): 

DOMINICK,  WAYNE  D.  * CHUM,  FRANK  Y.  * TRIANT AFYLLOPOULOS,  SPIROS 
AFFILIATION: 

UNIVERSITY  OF  SOUTHWESTERN  LOUISIANA 
ABSTRACT:  . 

THIS  ENTRY  CONTAINS  VARIOUS  ANALYSIS  AND  EVALUATION  ARTICLES,  MAGAZINES 
AND  OTHER  INFORMATION  SOURCES  THAT  DISCUSS  PERSONAL  COMPUTERS.  THIS 
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INFORMATION  IS  NEEDED  IN  ORDER  TO  PERFORM  COST/EFFECTIVENESS  ANALYSIS  OVER 
EQUIPMENT  TO  BE  USED  IN  THE  NASA/RECON  AND  OTHER  SUBSEQUENT  PROJECTS. 

KEYWORDS: 

NASA  INFORMATION  SYSTEM  * EQUIPMENT  SELECTION  » EQUIPMENT  EVALUATION 

t*****tt************t*******t**t***tt*tt$.*t*****t**t:^**ttt******t*********^ 

REFERENCE  CODE:  26 

JOURNAL: 

INFORMATION  TODAY 
DATE:  01/01/84 

TITLE: 

INFORMATION  TODAY 
AUTHOR(s): 


AFFILIATION: 

LEARNED  INFORMATION,  INC. 

ABSTRACT: 

THIS  MONTHLY  MAGAZINE  CONTAINS  INFORMATION  ABOUT  THE  DESIGN,  USAGE  AND 
ADMINISTRATION  OF  LARGE  ON-LINE  INFORMATION  SYSTEMS.  ITS  ARTICLES  COVER 
FEATURE  ANALYSES  OF  INFORMATION  SYSTEMS,  EQUIPMENT  AND  SERVICE  REVIEWS, 
USERS  VIEWS  AND  OTHER  INFORMATION  RELEVAND  TO  THE  NASA/RECON  CONTRACT. 

KEYWORDS: 

INFORMATION  SYSTEMS  * ON-LINE  SYSTEMS  * INFORMATION  STORAGE  AND  RETRIEVAL 
SYSTEMS  * ELECTRONIC  INFORMATION  SYSTEMS 


REFERENCE  CODE:  27 

JOURNAL: 

DATE:  02/15/84 
TITLE: 

NASA/RECON  WORKSHOP  EVALUATION  RESULTS 
AUTHOR(s): 

DOMINICK,  WAYNE  D.  * TRIANTAFYLLOPOULOS,  SPIROS  * USL  NASA/RECON  WORKSHOP 
PARTICIPANTS 

AFFILIATION: 

UNIVERSITY  OF  SOUTHWESTERN  LOUISIANA 
ABSTRACT: 

THIS  ENTRY  CONTAINS  THE  RESPONSES  OF  THE  USL  NASA/RECON  WORKSHOP 
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PARTICIPANTS  TO  THE  EVALUATION  QUESTIONNAIRE.  ALL  QUESTIONNAIRES  AND 
COMMENTS  ARE  INCLUDED.  ALSO  INCLUDED  IS  A STATISTICAL  ANALYSIS  OF  THE 
RESULTS  AND  THE  COVER  LETER  TO  NASA,  HQ. 

KEYWORDS: 

NASA/RECON  WORKSHOP  EVALUATION  » RESULTS  EVALUATION 

CATEGORIES: 

3.5  * 3.7 


REFERENCE  CODE:  28 

JOURNAL: 

DATE:  12/01/83 
TITLE: 

CORPORATE  SOURCE  AUTHORITY  LIST 
AUTHOR(s): 

NATIONAL  AERONAUTICS  AND  SPACE  ADMINISTRATION 
AFFILIATION: 

NATIONAL  AERONAUTICS  AND  SPACE  ADMINISTRATION 
ABSTRACT: 

THE  LISTED  CORPORATE  SOURCES  HAVE  BEEN  APPROVED  FOR  USE  IN  THE  CUMMULATIV 
INDEXES  TO  THE  NASA  ABSTRACT  JOURNALS.  THE  CODED  TERMS  ARE  USED  IN 
COMPLETING  THE  DOCUMENT  PROCESSING  FORMS  OR  APPROVED  SUBSTITUTE  FORMS. 
THESE  ABRIDGED  ENTRIES  HAVE  BEEN  DEVELOPED  FROM  THE  FULL  CORPORATE  AUTHOF 
THAT  APPEAR  IN  THE  CITATIONS  USED  IN  THE  ABSTRACT  SECTION. 

KEYWORDS; 

ABSTRACT  JOURNALS  * INFORMATION  SOURCES  * AUTHORITY  LIST 

CATEGORIES: 

3.5  * 3.7 

*<*♦**»»♦<♦»»»»»»♦*«»»»**»♦»»***»»*»**♦**<«»»»»**♦♦*♦***»♦»*♦♦»»»»*»***♦»» 

REFERENCE  CODE:  29 

JOURNAL: 

DATE:  01/31/84 
TITLE: 

NASA/RECON  WORKSHOP  TRAINING  MATERIAL 
AUTHOR(s): 

NATIONAL  AERONAUTICS  AND  SPACE  ADMINISTRATION 
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AFFILIATION: 

NATIONAL  AERONAUTICS  AND  SPACE  ADMINISTRATION 
ABSTRACT: 

THIS  ENTRY  INCLUDES  ALL  STANDARD  MATERIAL  PRESENTED  IN  A NASA/RECON 
WORKSHOP.  IT  CONTAINS  COPIES  OF  ALL  FOILS  USED,  HANDOUTS,  POCKET  GUIDES, 

FILE  COLLECTION  DETAILS  AND  OTHER  INFORMATION  RELEVANT  TO  THE  WORKSHOP. 
INCLUDED  ARE  A COPY  OF  THE  INTRODUCTION  MATERIAL  IN  THE  NASA/RECON  USER’S 
MANUAL  AND  A COLLECTION  OF  ADDITIONAL  HANDOUTS  DISTIRBUTED  AT  THE  U.S.L. 
SPECIAL  TRAINING  SESSION. 

KEYWORDS: 

NASA/RECON  WORKSHOP  * TRAINING  MATERIAL  * INFORMATION  STORAGE  AND  RETRIEVE 

CATEGORIES: 

3.5  • 3.7 


REFERENCE  CODE:  30 

JOURNAL: 

DATE:  01/31/84 
TITLE: 

USL  NASA/RECON  WORKSHOP  ADMINISTRATION. 

AUTHOR(s): 

DOMINICK,  WAYNE  D.  * NATIONAL  AERONAUTICS  AND  SPACE  ADMINISTRATION 
AFFILIATION: 

UNIVERSITY  OF  SOUTHWESTERN  LOUISIANA  ♦ NATIONAL  AERONAUTICS  AND  SPACE 
ADMINISTRATION 

ABSTRACT: 

THIS  ENTRY  INCLUDES  ALL  ADMINISTRATIVE  DOCUMENTS  USED  PRIOR,  DURING  AND 
AFTER  THE  NASA/RECON  WORKSHOP  GIVEN  AT  THE  UNIVERSITY  OF  SOUTHWESTERN 
LOUSIANA. 

KEYWORDS: 

NASA/RECON  WORKSHOP  * WORKSHOP  ADMINISTRATION  » INFORMATION  STORAGE  AND 
RETRIEVAL 

CATEGORIES: 

3.5  « 3.7 


♦**************************»******»****»»*»**********»**********««*****s*** 


REFERENCE  CODE:  31 

JOURNAL: 
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DATE:  01/31/84 


TITLE: 

NASA/RECON  WORKSHOP  ADDITIONAL  HANDOUTS 
AUTHOR(s): 

DOMINICK,  WAYNE  D. 

AFFILIATION: 

UNIVERSITY  OF  SOUTHWESTERN  LOUISIANA 
ABSTRACT: 

THIS  ENTRY  INCLUDES  ALL  ADDITIONAL  HANDOUTS  PRESENTED  TO  THE  NASA/RECON 
TRAINING  WORKSHOP  AT  THE  UNIVERSITY  OF  SOUTHWESTERN  LOUISIANA.  ENTRIES 
INCLUDE  THE  WORKSHOP  AGENDA  AND  LIST  OF  ATTENDEES. 

KEYWORDS: 

NASA/RECON  WORKSHOP  * TRAINING  MATERIAL  * ADDITIONAL  HANDOUTS  » 
ADMINISTRATION 

CATEGORIES: 

3.5  * 3.7 

REFERENCE  CODE:  32 

JOURNAL: 

DATE:  01/31/84 
TITLE: 

NASA/RECON  WORKSHOP  CERTIFICATES/LETTERS 
AUTHOR(s): 

DOMINICK,  WAYNE  D.  » CHUM,  FRANK  Y. 

AFFILIATION: 

UNIVERSITY  OF  SOUTHWESTERN  LOUISIANA 
ABSTRACT: 

THIS  ENTRY  INCLUDES  ALL  CERTIFICATES  ISSUED  TO  THE  NASA/RECON  TRAINING 
WORKSHOP  ATTENDEES  AT  THE  UNIVERSITY  OF  SOUTHWESTERN  LOUISIANA.  ENTRIES 
ALSO  INCLUDE  FOLLOW-UP  LETTERS  PRESENTED  TO  THE  INSTRUCTORS  AND  ATTENDEES 
AFTER  THE  WORKSHOP. 

KEYWORDS: 

NASA/RECON  WORKSHOP  » CERTIFICATES  OF  ATTENDANCE  * LETTERS  TO  ATTENDEES 

CATEGORIES: 

3.5  * 3.7 
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REFERENCE  CODE:  33 

JOURNAL: 

DATE:  01/31/84 
TITLE: 

NASA/RECON  WORKSHOP  NOTES 
AUTHOR(s): 

DOMINICK,  WAYNE  D.  * ATTENDEES  OF  THE  NASA/RECON  WORKSHOP  AT  USL 
AFFILIATION: 

UNIVERSITY  OF  SOUTHWESTERN  LOUISIANA 
ABSTRACT: 

THIS  ENTRY  INCLUDES  NOTES  TAKEN  DURING  THE  NASA/RECON  TRAINING  WORKSHOP  A 
THE  UNIVERSITY  OF  SOUTHWESTERN  LOUISIANA.  THESE  NOTES  WERE  TAKEN  FROM  THE 
ATTENDEES’  NOTES  DURING  THE  WORKSHOP. 

KEYWORDS: 

NASA/RECON  WORKSHOP  * WORKSHOP  NOTES 

CATEGORIES: 

3.5  * 3.7 
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REFERENCE  CODE:  34 

JOURNAL: 

DATE:  01/31/84 
TITLE: 

NASA/RECON  CONTRACT  PUBLICITY 
AUTHOR(s): 

DOMINICK,  WAYNE  D. 

AFFILIATION: 

UNIVERSITY  OF  SOUTHWESTERN  LOUISIANA 
ABSTRACT: 

THIS  ENTRY  INCLUDES  ALL  PUBLICITY  DOCUMENTS  CONCERNING  THE  NASA/RECON 
CONTRACT  AT  THE  UNIVERSITY  OF  SOUTHWESTERN  LOUISIANA. 

KEYWORDS: 

NASA/RECON  * PUBLICITY 
CATEGORIES: 
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3.5  * 3.7 


REFERENCE  CODE:  35 

JOURNAL: 

DATE:  01/31/84 
TITLE: 

NASA-USL  NEW  COURSES  INFO 
AUTHOR(s): 

DOMINICK,  WAYNE  D. 

AFFILIATION: 

UNIVERSITY  OF  SOUTHWESTERN  LOUISIANA 
ABSTRACT: 

THIS  ENTRY  INCLUDES  ALL  ADMINISTRATIVE  DOCUMENTS  RELATED  TO  THE 
DEVELOPMENT  OF  NEW  COURSES  AT  THE  UNIVERSITY  OF  SOUTHWESTERN  LOUISIANA. 

KEYWORDS: 

NASA/RECON  » NEW  COURSES  * COURSE  DEVELOPMENT 

CATEGORIES: 

3.5  * 3.7 


***t****t*****t***t*******t*t*********************t**t***t*t***********t*** 


REFERENCE  CODE:  36 

JOURNAL: 

DATE:  01/31/84 
TITLE: 

NASA-RESEARCH  AND  DEVELOPMENT  FUTURES 
AUTHOR(s): 

DOMINICK,  WAYNE  D. 

AFFILIATION: 

UNIVERSITY  OF  SOUTHWESTERN  LOUISIANA 
ABSTRACT: 

THIS  ENTRY  INCLUDES  ALL  ENTRIES  CONCERNING  FUTURE  RESEARCH  AND  DEVELOPMEN 
TOPICS  WITHIN  THE  USL/SU  NASA/RECON  CONTRACT. 

KEYWORDS: 

NASA/RECON  * RESEARCH  AND  DEVELOPMENT 
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CATEGORIES: 
3.5  » 3.7 
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REFERENCE  CODE:  37 

JOURNAL: 

DATE:  02/01/84 
TITLE: 

NASA-MISCELLANEOUS  NEWS/ANNOUNCEMENTS 
AUTHOR(s): 

NATIONAL  AERONAUTICS  AND  SPACE  ADMINISTATION 
AFFILIATION: 

NATIONAL  AERONAUTICS  AND  SPACE  ADMINISTRATION 
ABSTRACT: 

THIS  ENTRY  INCLUDES  ALL  MISCELLANEOUS  NEWS  AND  ANNOUNCEMENTS  ABOUT  THE 
NASA/RECON  USL/SU  CONTRACT  AND  RESEARCH  ACTIVITIES. 

KEYWORDS: 

NASA/RECON  * MISCELLANEOUS  NEWS  ♦ ANNOUNCEMENTS 

CATEGORIES:  ' 

3.5  » 3.7 
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REFERENCE  CODE:  38 

JOURNAL: 

DATE:  02/01/84 
TITLE: 

NASA-SPECIAL  PUBLICATIONS:  FUEL  ECONOMY  IN  AVIATION 
AUTHOR(s): 

NATIONAL  AERONAUTICS  AND  SPACE  ADMINISTATION 
AFFILIATION: 

NATIONAL  AERONAUTICS  AND  SPACE  ADMINISTRATION 
ABSTRACT: 

THIS  ENTRY  IS  A TYPICAL  ENTRY  OF  NASA  SPECIAL  PUBLICATIONS.  THIS  BOOK 
DESCRIBES  ADVANCES  IN  RESEARCH  AND  DEVELOPMENT  IN  FUEL  ECONOMY  IN 
AVIATION. 

KEYWORDS: 
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NASA/RECON  * SPECIAL  PUBLICATIONS  * FUEL  ECONOMY  * AVIATION 

CATEGORIES: 

3.5  » 3.7 
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REFERENCE  CODE:  39 

JOURNAL: 

DATE:  02/15/84 
TITLE: 

NASA/RECON  WORKSHOP  EVALUATION  RESULTS 
AUTHOR(s); 

DOMINICK,  WAYNE  D.  * TRIANTAFYLLOPOULOS,  SPIROS  ♦ USL  NASA/RECON  WORKSHOP 
PARTICIPANTS 

AFFILIATION: 

UNIVERSITY  OF  SOUTHWESTERN  LOUISIANA 
ABSTRACT: 

THIS  ENTRY  CONTAINS  THE  RESPONSES  OF  THE  USL  NASA/RECON  WORKSHOP 
PARTICIPANTS  TO  THE  EVALUATION  QUESTIONNAIRE.  ALL  QUESTIONNAIRES  AND 
COMMENTS  ARE  INCLUDED.  ALSO  INCLUDED  IS  A STATISTICAL  ANALYSIS  OF  THE 
RESULTS  AND  THE  COVER  LETER  TO  NASA,  HQ. 

KEYWORDS: 

NASA/RECON  WORKSHOP  EVALUATION  * RESULTS  EVALUATION 

CATEGORIES: 

3.5  * 3.7 
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REFERENCE  CODE:  40 

JOURNAL: 

DATE:  01/01/84 
TITLE: 

COMBINED  FILE  POSTING  STATISTICS  BASED  ON  NASA  THESAURUS 
AUTHOR(s): 

NATIONAL  AERONAUTICS  AND  SPACE  ADMINISTRATION 
AFFILIATION: 

NATIONAL  AERONAUTICS  AND  SPACE  ADMINISTRATION 
ABSTRACT: 
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THIS  ALPHABETICAL  LISTING  OF  POSTABLE  SUBJECT  TERMS  CONTAINED  IN  THE  NASA 
THESAURUS  IS  USED  TO  DISPLAY  THE  NUMBER  OF  POSTINGS  (DOCUMENTS)  INDEXED  BY 
EACH  SUBJECT  TERM  FROM  1968  TO  DATE.  THE  POSTING  TOTALS  PER  TERM  ARE 
SEPARATED  BY  ANNOUNCEMENT  OR  OTHER  MEDIA  INTO  STAR,  lAA,  CSTAR,  AND  OTHER 
COLUMNAR  ENTRIES  COVERING  THE  NASA  DOCUMENT  COLLECTION. 

KEYWORDS: 

FILE  STATISTICS  * INFORMATION  STORAGE  AND  RETRIEVAL  • PERFORMANCE 
MEASURMENT  AND  EVALUATION  * NASA  THESAURUS 

CATEGORIES: 

3.51  » 3.7  » 4.6 
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REFERENCE  CODE:  41 

JOURNAL: 

DATE:  01/01/84 
TITLE: 

GENERAL  NASA  CORRESPONDENCE 
AUTHOR(s): 

NATIONAL  AERONAUTICS  AND  SPACE  ADMINISTATION 
AFFILIATION: 

NATIONAL  AERONAUTICS  AND  SPACE  ADMINISTRATION 
ABSTRACT: 

THIS  ENTRY  CONTAINS  GENERAL  NASA/USL/SU  CORRESPONDENCE  RELATED  TO  THE 
NASA/RECON  CONTRACT. 

KEYWORDS: 

NASA/RECON  * CORRESPONDENCE 

CATEGORIES: 

3.5  * 3.7 
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REFERENCE  CODE:  42 

JOURNAL: 

DATE:  03/14/84 
TITLE: 

NASA-PUBLICATIONS  INFORMATION 
AUTHOR(s): 

DOMINICK,  WAYNE  D.  * CHUM,  FRANK  Y.  • TRIANTAFYLLOPOULOS,  SPIROS 
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AFFILIATION: 

UNIVERSITY  OF  SOUTHWESTERN  LOUISIANA 
ABSTRACT: 

THIS  ENTRY  IS  A CATALOG  OF  PUBLICATIONS  RELATED  TO  THE  USL/SU  NASA/RECON 
CONTRACT. 

KEYWORDS: 

NASA/RECON  » PUBLICATION  LIST  * DOCUMENTATION 

CATEGORIES: 

3.5  * 3.7 
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REFERENCE  CODE:  43 

JOURNAL: 

DATE:  03/14/84 
TITLE: 

NASA-DIALOG  INFORMATION 
AUTHOR(s): 

DOMINICK,  WAYNE  D.  * CHUM,  FRANK  Y.  * TRIANTAFYLLOPOULOS,  SPIROS 
AFFILIATION: 

UNIVERSITY  OF  SOUTHWESTERN  LOUISIANA 
ABSTRACT: 

THIS  ENTRY  CONTAINS  DOCUMENTS  RELATED  TO  THE  LOCKHEED  DIALOG  INFORMATION 
STORAGE  AND  RETRIEVAL  SYSTEM.  THIS  ENTRY  COVERS  SUBJECTS  SUCH  AS  TRAINING, 
COSTS,  ACCESSIBILITY,  ETC. 

KEYWORDS: 

DIALOG  * INFORMATION  STORAGE  AND  RETRIEVAL  SYSTEMS  * LOCKHEED  DIALOG 

CATEGORIES: 

3.5  * 3.7 
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REFERENCE  CODE:  44 

JOURNAL: 

DATE:  03/14/84 
TITLE: 

LASER  PRINTER  INFORMATION 
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AUTHOR(s): 

CHUM,  FRANK  Y.  * USL  COMPUTER  CENTER  STAFF 
AFFILIATION: 

UNIVERSITY  OF  SOUTHWESTERN  LOUISIANS 
ABSTRACT: 

THIS  ENTRY  CONTAINS  INFORMATION  ABOUT  THE  USL  LASER  PRINTER.  INCLUDED  ARE 
CONTROL  SEGMENT  EXAMPLES,  AVAILABLE  FONT  SAMPLES,  GENERAL  PRINTER 
INFORMATION  AND  FINISHED  SAMPLES  OF  THE  LASER  PRINTER. 

KEYWORDS: 

NASA/RECON  » LASER  PRINTER  » PRINTER  * DOCUMENTATION 

CATEGORIES: 

3.5  * 3.7 


REFERENCE  CODE:  45 

JOURNAL: 

DATE:  03/14/84 
TITLE: 

NASA  - LASER  ORIGINALS 
AUTHOR(s): 

DOMINICK,  WAYNE  D.  ♦ CHUM,  FRANK  Y.  * TRIANTAFYLLOPOULOS,  SPIROS 
AFFILIATION: 

UNIVERSITY  OF  SOUTHWESTERN  LOUISIANS 
ABSTRACT: 

THIS  ENTRY  CONTAINS  THE  ORIGINAL  COPIES  OF  ALL  REPORTS  PRODUCED  BY  THE  USL 
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SUPPLIER  STAFF.  A SECOND  FORM  IS  THE  DATABASE  SEMINAR,  WHERE 
SEARCHERS  INVESTIGATE  TOPICS  ON  DIVERSE  DATABASES  AND  SYSTEM 
AND  THEN  REPORT  TO  EACH  OTHER  IN  AN  INFORMAL  SETTING.  THIS 
PROVED  TO  BE  A POPULAR  AND  COST-EFFECTIVE  TRAINING 
TECHNIQUE,  ESPECIALLY  FOR  SEARCH  STRATEGY.  THE  TWO  KINDS  OF 
DATABASE  TRAINING  SEEM  TO  COMPLEMENT  EACH  OTHER. 
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IS  THAT  THE  SERVICES  ARE  PRIMARILY  BEING  MARKETED  TO  AND 
USED  BY  END  USERS,  WITH  LIBRARIES  AND  INFORMATION  CENTERS 


- 11  - 


LARGELY  BEING  BYPASSED.  SOME  NONBIBLIOGRAPHIC  DATABASE 
SERVICES  ARE  END-USER  ORIENTED,  BUT  THERE  ARE  MANY  OTHERS  IN 
IMPROVING  AND  EXTENDING  TRADITIONAL  REFERENCE  AND  OTHER 
LIBRARY  AND  INFORMATION  SERVICES. 

KEYWORDS: 

BIBLIOGRAPHIC  DATABASE  * REFERRAL  DATABASE  * NUMERIC  * 
TEXTUAL-NUMERIC  * REFERENCE  DATABASE  * SOURCE  DATABASE  * 
DIRECTORY  » GENERALIZED  SYSTEM 

CATEGORIES: 

2 * 3.51  * 3.7  » 3.81  * 4.33 

REFERENCE  CODE:  26 

DATE:  1983 

TITLE: 

DATA  BASE  DESIGN(2ND  ED.) 

AUTHOR(S): 

WIEDERHOLD,  G. 

AFFILIATION: 

STANFORD  UNIVERSITY 

PUBLISHER: 

MCGRAW-HILL 

*******t*******t****************t**t*****t*t**t**t**t************ 

REFERENCE  CODE:  27 

JOURNAL: 

IBM  SYSTEMS  JOURNAL 
VOLUME:  16 

ISSUE:  4 

DATE:  1977 
PAGES:  324  - 343 

TITLE: 

QUERY-BY-EXAMPLE:  A DATA  BASE  LANGUAGE 

AUTHOR(s): 

ZLOOF,  MOSHE  M. 

ABSTRACT: 

THIS  PAPER  IS  ALMOST  A USER’S  GUIDE  FOR  THE  QUERY-BY-EXAMPLE 
DATABASE  LANGUAGE.  THE  RETRIEVAL,  MANIPULATION,  AND 
DEFINITION  FEATURES  OF  THIS  SYSTEM  ARE  ILLUSTRATED  BY  AN 
EXTENSIVE  SERIES  OF  INCREMENTAL  EXAMPLES.  THIS  PAPER  IS 
WRITTEN  TOTALLY  FROM  THE  USERS’  POINT  OF  VIEW.  THE  TECHNICAL 


- 12  - 


ISSUE:  6 

DATE:  AUGUST  1983 
PAGES:  28  - 29 


TITLE: 

ONLINE  AGE:  ASSESSMENT  & DIRECTION 

AUTHOR(s): 

NEWMAN,  L. 

AFFILIATION: 

UNIVERSITY  OF  CINCINNATI 
ABSTRACT: 

THIS  ARTICLE  DISCUSSED  THE  ISSUE  OF  WHO  THE  INFORMATION 
SPECIALISTS  ARE  AND  HOW  THEY  SHOULD  BE  EDUCATED  AND  TRAINED. 

KEYWORDS: 

INFORMATION  SPECIALIST  * END  USER  * DATABASES  * ONLINE 
INFORMATION  SERVICE 

CATEGORIES: 

2.2  » 3.7  * 4.33 


REFERENCE  CODE;  30 

JOURNAL: 

JASIS 

VOLUME:  31 

ISSUE:  3 

DATE:  MAY  1980 
PAGES:  161  - 170 

TITLE: 

ON-LINE  SYSTEMS  OF  DISCIPLINES  AND  SPECIALTY  AREA  IN  SCIENCE 
AND  TECHNOLOGY 

AUTHOR(s): 

REGAZZI,  J.  J.  * BENNION,  B.  * ROBERTS,  S. 

AFFILIATION: 

RUTGERS  UNIVERSITY  * USC  * AMERICAN  MEDICAL  ASSOCIATION 
ABSTRACT: 

OVER  130  ON-LINE  BIBLIOGRAPHIC  DATABASES  IN  SCIENCE  AND 
TECHNOLOGY,  AVAILABLE  THROUGH  COMMON  VENDORS  AS  OF  DECEMBER 
1979.  ARE  IDENTIFIED  AND  REVIEWED.  THESE  HAVE  BEEN 
CLASSIFIED  AS  (l)  DISCIPLINE-WIDE,  TRANSDISCIPLINARY,  OR 
MULTIDISCIPLINARY  AND  (2)  SPECIALTY  OR  PROBLEM-ORIENTED. 

SELECTED  DATABASES  OF  BOTH  TYPES  ARE  DISCUSSED,  INCLUDING 
AREAS  COVERED  AND  FUNCTIONS  SERVED. 


- 14  - 


KEYWORDS: 

ON-LINE  DATABASES  ♦ VENDOR  CONSIDERATIONS  * INFORMATION 
STORAGE  & RETRIEVAL 

CATEGORIES: 

3.7  * 3.81  * 4.33 

*****************************************.%*********************** 


REFERENCE  CODE:  31 

JOURNAL: 

COMPUTER  MANAGEMENT 
DATE:  MAY  1983 
PAGES:  25  - 28 


TITLE: 

DATA  MANAGEMENT 

AUTHOR(s): 

MANCHESTER,  P. 

ABSTRACT: 

THE  POWER  OF  DATA  DEPENDS  VERY  MUCH  ON  HOW  IT  HAS  BEEN 
STORED.  THE  AUTHOR  REPORTS  ON  THE  LATEST  TECHNIQUES  OF 
ORGANIZING  INFORMATION 

KEYWORDS: 

DATA  STORAGE  * DATA  STRUCTURES  * FILE  ORGANIZATION 

CATEGORIES: 

4.34  * 5.6 

««««*»»««»«»««***««»«««»»«*«»«««*«**««««««***««»««««*«»*«*»«****« 

REFERENCE  CODE:  32 

JOURNAL: 

COMPUTING  & ELECTRICAL  ENGRINEERING 

VOLUME:  10 

ISSUE:  1 

DATE:  1983 

PAGES:  3-9 

TITLE: 

A COMPARISON  OF  PROCESSING  TIMES  FOR  UPDATE  REQUESTS  IN  TWO 
LOCKING  SCHEMES 

AUTHOR(s): 

FUNG,  K.T.  * LAM,  C.M. 

AFFILIATION: 


- 15  - 


AMERICAN  BELL 


ABSTRACT: 

MODELS  ARE  DEVELOPED  FOR  THE  PRIMARY  SITE  AND  THE  PRIMARY 
COPY  LOCKING  SCHEMES  FOR  CONCURRENCY  CONTROL  IN  DISTRIBUTED 
DATABASES.  THESE  MODELS  ARE  THEN  ANALYZES  TO  OBTAIN  ANALYTIC 
RESULTS,  WHICH  ENABLE  ONE  TO  CONVENIENTLY  MAKE  COMPARISONS 
OF  TWO  LOCKING  SCHEMES  IN  TERMS  OF  THEIR  PROCESSING  TIMES 
FOR  UPDATE  REQUESTS  AS  WELL  AS  OTHER  DESIGN  DECISIONS,  THE 
ANALYSIS  FOLLOWS  AN  APPROACH  BASED  ON  A SYSTEMATIC 
ASSIGNMENT  OF  COMPARABLE  VALUES  TO  CORRESPONDING  PARAMETERS 
IN  THE  TWO  MODELS. 

KEYWORDS: 

DATABASES  * SYSTEMS  DESIGN  * SYSTEMS  EVALUATION  * 

DISTRIBUTED  DATABASES 

CATEGORIES: 

3.72  ♦ 4.33 


REFERENCE  CODE:  33 

JOURNAL: 

REFERENCE  LIBRARY 
DATE:  1982 
PAGES:  143  - 53 

TITLE: 

FREE-TEXT  SEARCHING  OF  ONLINE  DATABASES 

AUTHOR(s): 

KNAPP,  S.  D. 

AFFILIATION: 

STATE  UNIVERSITY  OF  NEW  YORK 
ABSTRACT: 

THIS  ARTICLE  OFFERS  HINTS  ON  IMPROVEMENT  OF  FREE-TEXT 
SEARCHING  SKILLS  AND  DISCUSSES  THE  MAIN  PROBLEMS  OF  SEARCH, 
SOURCES  OF  FREE-TEXT  TERMS,  AND  STRATEGIES  FOR  FINDING  TERMS 
ON  LINE. 

KEYWORDS: 

SEARCHING  * ONLINE  INFORMATION  * DATABASE  * SEARCH  STRATEGIES 
CATEGORIES: 

3.51  » 3.72  » 3.74  * 3.8  * 4.33 


REFERENCE  CODE:  34 


- 16  - 


JOURNAL: 

REFERENCE  LIBRARY 
DATE:  1982 
PAGES:  155  - 163 

TITLE: 

EFFECTIVE  ONLINE  LITERATURE  SEARCHING 

AUTHOR(s): 

MCMARTIN,  M.  L. 

AFFILIATION: 

UNIVERSITY  OF  VIRGINIA 

ABSTRACT: 

THE  ARTICLE  REVIEWS  FACTORS  WHICH  AFFECT  ONLINE  SEARCHING, 
AND  ESPECIALLY  THE  PREPARATION  OF  A SEARCH  STRATEGY.  IT  ALSO 
DISCUSSES  SEARCH  TRAINING,  SEARCH  AIDS  AND  REQUEST  FORMS, 
INTERVIEWING  AND  PROFILE  CONSTRUCTION,  SEARCH  EVALUATION, 
AND  DOCUMENT  DELIVERY,  PROFESSIONAL  READING  FOR  THE  SEARCH 
ANALYST  IS  LISTED. 

KEYWORDS: 

SEARCHING  » ONLINE  INFORMATION  * DATABASE  * USER’S  BEHAVIOR 
* SEARCH  AIDS  * SEARCH  STRATEGY 

CATEGORIES: 

3.51  * 3.74  » 3.8 


REFERENCE  CODE:  35 

JOURNAL: 

REFERENCE  LIBRARY 
DATE:  1982 
PAGES:  173  - 80 

TITLE: 

ONLINE  AND  MANUAL  SEARCHES:  A COMPARISON 

AUTHOR(s): 

SHUMAN,  B.  A. 

AFFILIATION: 

QUEENS  COLLEGE  * UNIVERSITY  OF  NEW  YORK 
ABSTRACT: 

THIS  ARTICLE  DISCUSSES  THE  RESULTS  OF  A YEAR-LONG  EXPERIMENT 
USING  25  STUDENTS  ENROLLED  IN  A GRADUATE-LEVEL  DATABASE 
REFERENCE  COURSE,  PSYCHOLOGICAL  FACTORS  ARE  FOUND  TO  DEPEND 
ON  THE  INDIVIDUAL  AND  ON  THE  SYSTEM  HARDWARE  AND  SOFTWARE. 


- 17  - 


KEYWORDS: 

DATABASE  * SEARCHING  ♦ ONLINE  INFORMATION  * USER’S  BEHAVIOR 
» HARDWARE  * SOFTWARE 

CATEGORIES: 

2.1  * 3.36  * 3.51  * 3.74 


*********t*******t*****t****tx******t******tt********%t*****t**** 


REFERENCE  CODE:  36 

JOURNAL: 

REFERENCE  LIBRARY 
DATE:  1982 
PAGES:  187  - 94 

TITLE: 

DATABASE  CHOICE:  A PRACTICAL  ASSESSMENT 

AUTHOR(s): 

HALPERIN,  M. 

AFFILIATION: 

DREXEL  UNIVERSITY 

ABSTRACT: 

THE  DATABASE  SELECTION  PROCESS  IS  EXAMINED  WITH  THE  AID  OF 
FLOWCHARTS,  AND  DATABASE  DESCRIPTIONS  ARE  COMPARED.  THE 
PRE-SEARCH  FOR  THE  RELEVANT  FILE  IS  LIKENED  TO  ONLINE  SEARCH 
FOR  THE  RELEVANT  CITATION.  AIDS  TO  CONSTRUCTION  OF  A SEARCH 
STRATEGY  ARE  SUGGESTED. 

KEYWORDS: 

SEARCHING  * SEARCH  AIDS  * DATABASE  * ONLINE  INFORMATION  * 
SEARCH  STRATEGY  * SYSTEM  EVALUATION 

CATEGORIES: 

3.74  * 3.8  * 5.6  * 4.9 


***********»*******M********»******»«*****»********************* 


REFERENCE  CODE:  37 

JOURNAL: 

J.  MICROGR. 

VOLUME:  16 

ISSUE:  1 

DATE:  JANUARY  1983 
PAGES:  25-9 

TITLE: 

MICROGRAPHICS:  A VITAL  LINK  IN  CAD/CAM  SYSTEMS 


- 18  - 


AUTHOR(s); 

RUPP,  D.  O. 

AFFILIATION: 

COLLEGE  OF  ST.  PAUL 

ABSTRACT: 

THIS  ARTICLE  GIVES  AN  INTRODUCTION  TO  CAD/CAM  SYSTEMS,  AND 
SHOWS  HOW  THEY  CAN  BE  INTEGRATED  WITH  MICROGRAPHICS  TO 
PROVIDE  A TOTAL  ENGINEERING  INFORMATION  SYSTEM.  SUCH  A 
SYSTEM  COULD  PLACE  NEW  DESIGN  CHANGES  QUICKLY  IN  THE  HANDS 
OF  USERS. 

KEYWORDS: 

SYSTEMS  DESIGN  » INFORMATION  SYSTEM  * MICROGRAPHICS 

CATEGORIES: 

3.7  * 3.8  * 4.39  » 5.6  * 7.1 

REFERENCE  CODE:  38 

JOURNAL: 

ONLINE  REVIEW 
VOLUME:  6 

ISSUE:  2 

DATE:  JUNE  1983 
PAGES:  127  - 33 

TITLE: 

STUDY  OF  STRATEGIES  USED  IN  ONLINE  SEARCHING  III.  QUERY 
REFINING 

AUTHOR(s): 

SCHRODER,  J,  J. 

AFFILIATION: 

LABORATORY  FOR  ELECTRONIC  DEVELOPMENT  OF  ARMED  FORCES  TNO 
ABSTRACT: 

TWELVE  DIFFERENT  WAYS  FOR  REDUCTION  OF  A LARGE  SET  BY 
REMOVAL  OF  IRRELEVANT  OR  UNWANTED  ELEMENTS  ARE  REVIEWED. 
METHODS  DISCUSSED  INCLUDE  LOGIC  REVISION,  CONCEPT  REVISION 
AND  TERMINOLOGY  REVISION.  EXAMPLES  ARE  GIVEN  FOR  EACH 
OPTION. 

KEYWORDS: 

ONLINE  SEARCHING  * INFORMATION  RETRIEVAL  * CONTENT  ANALYSIS 

CATEGORIES: 

3.71  • 3.74  * 3.8  * 5.21 


- 19  - 


*****t**t***t*************ttt*t*t***t*t**t****t*t**t*t*********** 


REFERENCE  CODE:  39 


JOURNAL: 

SOUTHCON  ’83 
DATE:  JANUARY  1983 
PAGES:  1 » 18  * 103 

TITLE: 

TECHNICAL  INFORMATION:  COMPUTERIZED  RETRIEVAL,  ACQUISITION 
AND  USE 

AUTHOR(s): 

LAFFERTY,  J.  J. 

AFFILIATION: 

LITE  INFORMATION  SERVICE  INCORPORATED 
ABSTRACT: 

THIS  ARTICLE  SHOWS  THAT  TO  GET  ONLINE  IS  TO  BECOME  THE 
BENEFICIARY  RATHER  THAN  THE  VICTIM  OF  THE  INFORMATION 
EXPLOSION 

KEYWORDS: 

SEARCH  * DIALOG  * INFORMATION  RETRIEVAL  » DATABASE  * ONLINE 
INFORMATION 

CATEGORIES: 

3.74  » 3.8  » 4.22  ♦ 5.2 


REFERENCE  CODE:  40 

JOURNAL: 

SOUTHCON  ’83 
DATE:  JANUARY  1983 
PAGES:  18 

TITLE: 

INFORMATION  STORAGE  AND  RETRIEVAL  THROUGH  DIALOG 

AUTHOR(s): 

KAMINECKI,  R.  M. 

AFFILIATION: 

DIALOG  INFORMATION  SERVICES  INCORPORATED 
ABSTRACT: 

THIS  ARTICLE  DESCRIBES  THE  ONLINE  SEARCH  USING  DIALOG  WHICH 
ENABLE  CALLING  OUT  OF  IRRELEVANT  CITATIONS  USING  BOOLEAN 


- 20  - 


LOGIC  OPERATORS  AND,  OR,  AND  NOT,  AND  GIVES  SOME  EXAMPLES 
KEYWORDS: 

SEARCH  * DIALOG  * INFORMATION  RETRIEVAL  » DATABASE  * ONLINE 
INFORMATION 

CATEGORIES: 

3.74  » 3.8  » 4.22  * 5.21 

***************************************************************** 

REFERENCE  CODE:  41 

JOURNAL: 

ELECTRO  ’83 
DATE:  APRIL  19  1983 
PAGES:  7 

TITLE: 

ONLINE  ENGINEERING  INFORMATION  AT  IBM 

AUTHOR(s): 

HASSLACHER,  G.  J. 

AFFILIATION: 

IBM  CORPORATION 

ABSTRACT: 

AT  IBM,  ENGINEERS  HAVE  SEVERAL  OPTIONS  FOR  DOING  TRADITIONAL 
LIBRARY  RESEARCH  USING  ONLINE  INFORMATION  RETRIEVAL  SYSTEMS. 
FOR  CONTINUING  INFORMATION  NEEDS  THEY  CAN  SUBSCRIBE  TO  THE 
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ABSTRACT: 

ONLINE  LITERATURE  SEARCHING  CAN  BE  USED  FOR  CLASSIFYING  THE 
PROLIFERATING  AND  DIVERSE  RESEARCH  PREVALENT  IN  THE  FIELD  OF 
INTERNATIONAL  BUSINESS.  THERE  HAS  BEEN  MUCH  RESEARCH  ON  HOW 
TO  APPLY  SEARCH  TERMS  AND  STRATEGIES  TO  INTERNATIONAL 
BUSINESS  LITERATURE  IN  THE  MOST  EFFECTIVE  WAY.  THE  KEY 
METHODOLOGY  USED  IN  INTERNATIONAL  BUSINESS  LITERATURE  CAN  BE 
SEPARATED  INTO  THREE  TYPES-ENTERPRISE  SPECIFIC,  HOST  COUNTRY 
AND  INTERNATIONAL  ENVIRONMENT.  THE  INTERRELATIONSHIPS 
BETWEEN  THESE  THREE  CATEGORIES  CAN  BE  EXPLOITED  TO  ALLOW 
EFFICIENT  ONLINE  SEARCHING 
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WORD  TRUNCATION  IS  A FAMILIAR  TECHNIQUE  EMPLOYED  BY  ONLINE 
SEARCHERS  IN  ORDER  TO  INCREASE  RECALL  IN  FREE  TEXT 
RETRIEVAL.  THE  USE  OF  TRUNCATION,  HOWEVER.  CAN  BE  MIXED 
BLESSING  SINCE  MANY  WORDS  STARTING  WITH  THE  SAME  ROOT  ARE 
NOT  SEMANTICALLY  OR  LOGICALLY  RELATED.  CONSEQUENTLY,  ONLINE 
SEARCHERS  OFTEN  SELECT  WORDS  TO  BE  OR-ED  TOGETHER  FROM  AN 
ALPHABETIC  DISPLAY  OF  NEIGHBOURING  TERMS  IN  THE  INVERTED 
FILE  IN  ORDER  TO  ASSURE  PRECISIONS  IN  THE  SEARCH.  AUTOMATIC 
STEMMING  ALGORITHMS  TYPICALLY  FUNCTION  IN  A MANNER  ANALOGOUS 
TO  WORD  TRUNCATION,  WITH  THE  ADDED  RISK  OF  WORD  ROOTS  BEING 
INCORRECTLY  IDENTIFIED  BY  THE  ALGORITHM.  THIS  PAPER 
DESCRIBES  A TWO-PHASE  STEMMING  ALGORITHM  THAT  CONSISTS  OF 
THE  IDENTIFICATION  OF  THE  W'ORD  ROOT  AND  THE  AUTOMATIC 
SELECTION  OF  ’WELL-FORMED’  MORPHOLOGICAL  WORD  VARIANTS  FROM 
THE  ACTUAL  INVERTED  FILE  ENTRIES  THAT  START  WITH  THE  SAME 
WORD  ROOT.  THE  ALGORITHM  HAS  BEEN  SUCCESSFULLY  USED  IN  AN 
END-USER  INTERFACE  TO  NLMS  CATLINE  BOOK  CATALOG  FILE 
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CATEGORIES:  INTERMEDIARIES  ONLY,  SELF  SEARCHING  ONLY,  AND 
TWO  COMBINATIONS  OF  INTERMEDIARIES  AND  SELF  SEARCHERS.  THE 
HYPOTHESIS  TESTED  WAS  THAT  INTERMEDIARIES  PERFORMED  BETTER 
ON  THE  SATISFACTION  SCALE  THAN  DID  ANY  OTHER  COMBINATIONS. 
THE  RESULTS  OF  TESTING  INDICATED  THAT  THIS  HYPOTHESIS  COULD 
NOT  BE  REJECTED.  FURTHER  TESTING  WAS  DONE  TO  DETERMINE 
REASONS  FOR  THIS  FAILURE  TO  REJECT.  THE  RESULTS  OF  THE 
ADDITIONAL  TESTING  INDICATED  THAT  THE  MAJOR  REASONS  FOR  LOW 
SATISFACTION  WAS  DIFFICULTY  WITH  PROTOCOL.  THE  RESULTS  OF 
THIS  STUDY  HAVE  SOME  IMPACT  ON  ONLINE  SEARCHING  IN  THE 
FUTURE  AS  WELL  AS  FOR  THE  PRESENT. 
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DUPLICATE  CITATIONS  WERE  FOUND  TO  BE  MORE  PERTINENT  THAN 
UNIQUE  CITATIONS.  THE  DUPLICATE  CITATIONS  CAME  FROM  A HIGHLY 
COMPACT  LITERATURE,  WHILE  THOSE  FROM  A SINGLE  DATABASE  WERE 
VERY  WIDELY  SCATTERED.  THE  PERTINENT  DUPLICATE  CITATIONS 
WERE  MORE  LIKELY  TO  BE  RETRIEVED  IN  SEARCHES  THAT  HAD  MORE 
TERMS  OVERALL,  AND  HAD  A HIGHER  PERCENTAGE  OF  THESAURUS 
TERMS,  AND  HAD  TERMS  WHICH  APPEARED  IN  BOTH  TITLE  AND 
ABSTRACT.  THESE  RESULTS  SUGGEST  THAT  THE  RATE  OF  DUPLICATION 
OF  CITATIONS  IN  MULTIDATABASE  SEARCHES  MAY  BE  USED  TO  RANK 
OUTPUT  ACCORDING  TO  PROBABLE  PERTINENCE 
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MODERN  INFORMATION  RETRIEVAL  SYSTEMS  ARE  DESIGNED  TO  SUPPLY 
RELEVANT  INFORMATION  IN  RESPONSE  TO  REQUESTS  RECEIVED  FROM 
THE  USER  POPULATION.  IN  MOST  RETRIEVAL  ENVIRONMENTS  THE 
SEARCH  REQUESTS  CONSISTS  OF  KEYWORDS,  OR  INDEX  TERMS, 
INTERRELATED  BY  APPROPRIATE  BOOLEAN  OPERATORS.  SINCE  IT  IS 
DIFFICULT  FOR  UNTRAINED  USERS  TO  GENERATE  EFFECTIVE  BOOLEAN 
SEARCH  REQUESTS,  TRAINED  SEARCH  INTERMEDIARIES  ARE  NORMALLY 
USED  TO  TRANSLATE  ORIGINAL  STATEMENTS  OF  USER  NEED  INTO 
USEFUL  BOOLEAN  SEARCH  FORMULATIONS.  METHODS  ARE  INTRODUCED 
IN  THIS  STUDY  WHICH  REDUCE  THE  ROLE  OF  THE  SEARCH 
INTERMEDIARIES  BY  MAKING  IT  POSSIBLE  TO  GENERATE  BOOLEAN 
SEARCH  FORMULATIONS  COMPLETELY  AUTOMATICALLY  FROM  NATURAL 
LANGUAGE  STATEMENTS  PROVIDED  BY  THE  SYSTEM  PATRONS. 

FREQUENCY  CONSIDERATIONS  ARE  USED  AUTOMATICALLY  TO  GENERATE 
APPROPRIATE  TERM  COMBINATIONS  AS  WELL  AS  BOOLEAN  CONNECTIVES 
RELATING  THE  TERMS.  METHODS  ARE  COVERED  TO  PRODUCE  AUTOMATIC 
QUERY  FORMULATIONS  BOTH  IN  A STANDARD  BOOLEAN  LOGIC  SYSTEM, 
AS  WELL  AS  IN  AN  EXTENDED  BOOLEAN  SYSTEM  IN  WHICH  THE  STRICT 
INTERPRETATION  OF  THE  CONNECTIVES  IS  RELAXED.  EXPERIMENTAL 
RESULTS  ARE  SUPPLIED  TO  EVALUATE  THE  EFFECTIVENESS  OF  THE 
AUTOMATIC  QUERY  FORMULATION  PROCESS,  AND  METHODS  ARE 
DESCRIBED  FOR  APPLYING  THE  AUTOMATIC  QUERY  FORMULATION 
PROCESS  IN  PRACTICE. 
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ONLINE  BIBLIOGRAPHIC  INFORMATION  SEEKING  ENVIRONMENT  CALLED 
DBASE  IS  DISCUSS^  VARIABLES  CONSIDERED  IN  THE  STUDY  ARE 
COMPUTER  aiding;  AVAILABILITY  OF  CITATION  LISTS,  DATABASE 
STRUCTURE,  AND  TYPE  OF  SEARCH  TASKS.  EFFECTS  OF  THESE 
VARIABLES  ON  SIX  PERFORMANCE  MEASURES  ARE  EXAMINED  USING 
ANALYSIS  OF  VARIANCE.  LINEAR  DISCRIMINANT  ANALYSIS  PROVIDES 
A MORE  FINE-GRAINED  ANALYSIS  OF  IMPORTANT  PROBLEM  FEATURES 
AND  FORMS  A BASIS  FOR  INVESTIGATING  DIFFERENCES  AMONG 
INDIVIDUAL  SEARCHERS  AND  THE  DYNAMIC  NATURE  OF  INFORMATION 
SEEKING  TASKS. 
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THE  RESEARCH  REPORTED  WAS  MOTIVATED  BY  THE  DESIRE  TO  KNOW 
WHETHER  FACULTY  WOULD  BE  ABLE  TO  PERFORM  ’ADEQUATE’ 

SEARCHES,  WHAT  TRAINING  MIGHT  BE  APPROPRIATE  AND  EFFECTIVE, 
WHAT  USE  THEY  WOULD  MAKE  OF  THE  ONLINE  SYSTEM,  WHAT  COMMON 
PROBLEMS  THEY  WOULD  ENCOUNTER  IN  SEARCHING,  AND  WHAT  SUPPORT 
FACULTY  MIGHT  REQUIRE  OF  THE  LIBRARY  IF  THEY  BECAME 
SEARCHERS.  TEN  SCIENCE  FACULTY  FROM  FIVE  DEPARTMENTS  AT  THE 
UNIVERSITY  OF  CALIFORNIA,  RIVERSIDE  WERE  OBSERVED  AND 
INTERVIEWED  DURING  THE  EIGHT  MONTHS  OF  THE  RESEARCH.  ALL  HAD 
SOME  FAMILIARITY  WITH  THE  PROCESS  OF  COMPUTERIZED  LITERATURE 
SEARCHING,  USUALLY  BECAUSE  THEY  HAD  BEEN  PRESENT  WHILE 
SEARCH  ANALYSIS  RAN  SEARCHES  FOR  THEM 
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DATABASE  SYSTEMS.  HOWEVER,  SINCE  THE  NUMBER  OF  POSSIBLE 
PHYSICAL  RECORD  STRUCTURES  FOR  DATABASE  OF  PRACTICAL 
SIGNIFICANCE  IS  ENORMOUS,  AND  THEIR  EVALUATION  IS  EXTREMELY 
COMPLEX,  DETERMINING  EFFICIENT  RECORD  STRUCTURES  BY  FULL 
ENUMERATION  IS  GENERALLY  INFEASIBLE.  THIS  PAPER  DISCUSSES 
THE  TECHNIQUES  OF  MATHEMATICAL  CLUSTERING,  ITERATIVE 
GROUPING  REFINEMENT,  MATHEMATICAL  PROGRAMMING,  AND 
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THIS  PAPER  STEMS  FROM  THE  DEEP  BELIEF  THAT  IMPROVED  HUMAN 
ENGINEERING  CAN  ADD  SIGNIFICANTLY  TO  THE  ACCEPTANCE  AND  USE 
OF  COMPUTER  TECHNOLOGY.  IN  PARTICULAR,  THIS  PAPER  DESCRIBES 
AN  EXPERIMENT  TO  TEST  THE  HYPOTHESIS  THAT  CERTAIN  FEATURES 
OF  NATURAL  LANGUAGE  PROVIDE  A USEFUL  GUIDE  FOR  THE  HUMAN 
ENGINEERING  OF  INTERACTIVE  COMMAND  LANGUAGES.  THE  GOAL  WAS 
TO  ESTABLISH  THAT  A SYNTAX  EMPLOYING  FAMILIAR,  DESCRIPTIVE, 
EVERYDAY  WORDS  AND  WELL-FORMED  ENGLISH  PHRASES  CONTRIBUTES 
TO  A LANGUAGE  THAT  CAN  BE  EASILY  AND  EFFECTIVELY  USED.  USERS 
WITH  VARYING  DEGREES  OF  INTERACTIVE  COMPUTING  EXPERIENCE 
USED  TWO  VERSIONS  OF  AN  INTERACTIVE  TEXT  EDITOR;  ONE  WITH  AN 
ENGLISH-BASED  COMMAND  SYNTAX  IN  THE  SENSE  DESCRIBED  ABOVE, 

THE  OTHER  WITH  A MORE  NOTATIONAL  SYNTAX.  PERFORMANCE 
DIFFERENCES  STRONGLY  FAVORED  THE  ENGLISH-BASED  EDITOR. 

KEYWORDS: 

HUMAN  ENGINEERING  « INTERACTIVE  LANGUAGE  * COMMAND  LANGUAGES 
* PSYCHOLOGY  OF  COMPUTER  USE 

CATEGORIES: 

3.36  * 4.6 


REFERENCE  CODE:  64 

JOURNAL: 

CACM 

VOLUME:  23 

ISSUE:  10 


- 34  - 


DATE:  OCTOBER  1980 
PAGES:  584  - 593 

TITLE: 

ANALYSIS  OF  LOCKING  POLICIES  IN  DATABASE  MANAGEMENT  SYSTEMS 
AUTHOR(s): 

POTIER,  D.  * LEBLANC,  P. 

AFFILIATION: 

INRIA,  FRANCE 

ABSTRACT: 

CONSISTENCY  CONTROL  HAS  TO  BE  ENFORCED  IN  DATABASE 
MANAGEMENT  SYSTEMS  (DBMS)  WHERE  SEVERAL  TRANSACTIONS  MAY 
CONCURRENTLY  ACCESS  THE  DATABASE.  THIS  CONTROL  IS  USUALLY 
ACHIEVED  BY  DIVIDING  THE  DATABASE  INTO  LOCKING  UNITS  OR 
GRANULES,  AND  BY  SPECIFYING  A LOCKING  POLICY  WHICH  ENSURES 
INTEGRITY  OF  THE  INFORMATION.  HOWEVER,  A DRAWBACK  OF 
INTEGRITY  ENFORCEMENT  THROUGH  LOCKING  POLICIES  IS  THE 
DEGRADATION  OF  THE  GLOBAL  SYSTEM  PERFORMANCE.  THIS  IS  MAINLY 
DUE  TO  THE  RESTRICTION  IMPOSED  BY  THE  LOCKING  POLICIES  TO 
THE  ACCESS  OF  TRANSACTIONS  TO  THE  DATABASE,  AND  TO  THE 
OVERHEADS  INVOLVED  WITH  THE  MANAGEMENT  OF  LOCKS.  A FRAMEWORK 
FOR  THE  QUANTITATIVE  ANALYSIS  OF  THE  IMPACT  OF  THESE  FACTORS 
ON  THE  PERFORMANCE  OF  DBMS  IS  PRESENTED  IN  THIS  PAPER.  IN  A 
FIRST  STEP,  THE  MAIN  FACTORS  WHICH  DETERMINE  THE  BEHAVIOR  OF 
THESE  SYSTEMS  ARE  POINTED  OUT  AND  ANALYZED  INDEPENDENTLY. 

THE  RESULTS  HEREBY  OBTAINED  ARE  AGGREGATED  IN  A SECOND  STEP 
TO  YIELD  A GLOBAL  PERFORMANCE  EVALUATION.  THROUGHOUT  THIS 
HIERARCHICAL  MODELING  APPROACH  VARIOUS  ANALYTICAL  TECHNIQUES 
ARE  USED  AND  THE  RESULTS  ARE  ILLUSTRATED  BY  NUMERICAL 
EXAMPLES.  THE  PAPER  CONCLUDES  BY  POINTING  OUT  THE  FINAL 
RESULTS’  SENSITIVITY  TO  SOME  BASIC  ASSUMPTIONS  CONCERNING 
TRANSACTION  BEHAVIOR  AND  THE  NEED  FOR  MORE  EXPERIMENTAL 
STUDIES  IN  THIS  AREA. 

KEYWORDS: 

CONSISTENCY  » CONCURRENCY  * DATABASE  MANAGEMENT  * 

PERFORMANCE  MODELING  * QUEUEING  MODELS  * QUEUEING  NETWORKS 

CATEGORIES: 

3.50  * 4.33  • 8.1 


*****•*♦♦*♦♦♦♦»********»*»*******»*»»*»*«****«**»*»*♦**♦**««***** 


REFERENCE  CODE:  65 

JOURNAL: 

SIGIR  * SIGMOD 
DATE:  MARCH  11  1980 
PAGES;  29  - 38 


- 35  - 


TITLE: 

EVALUATION  OF  ALTERNATIVE  DATA  BASE  MACHINE  DESIGNS 
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AFFILIATION: 

SUNY  * USAF/RADC  * SYRACUSE  UNIVERSITY 
ABSTRACT: 

THE  PURPOSE  OF  THIS  PAPER  IS  TO  POINT  OUT  THE  NEED  FOR 
PERFORMANCE  EVALUATION  MEASURES  AND  TECHNIQUES  SUITABLE  FOR 
THE  EVALUATION  OF  SPECIALIZED  ARCHITECTURAL  FEATURES  IN 
NONNUMERIC  APPLICATIONS.  TOWARD  THIS  END,  PROBLEMS 
ASSOCIATED  WITH  THE  USE  OF  DATABASE  MACHINES  ARE  EXAMINED  AT 
THREE  LEVELS  OF  DETAIL:  THE  USER  LEVEL,  THE  SYSTEM  LEVEL  AND 
THE  DEVICE  LEVEL. 
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ABSTRACT: 

THIS  PAPER  DISCUSSES  THE  PROBLEM  OF  SEARCHING  VERY  LARGE 
TEXT  DATABASES.  IT  IS  SHOWN  THAT  CONVENTIONAL  TECHNIQUES  FOR 
SEARCHING  CURRENT  DATABASES  CANNOT  BE  SCALED  UP  TO  LARGER 
ONES,  THAT  IT  IS  NECESSARY  TO  BUILD  HARDWARE  TO  SEARCH  THE 
DATABASE  IN  PARALLEL  IF  REASONABLE  SEARCH  TIMES  ARE 
EXPECTED.  THE  PART  OF  THE  SEARCH  PROCESS  REQUIRING  THE 
HIGHEST  HARDWIDTH  IS  SCANNING  THE  DATABASE  TO  DETECT 
INSTANCES  OF  SEARCH  TERMS.  METHODS  OF  DOING  THIS  IN  HARDWARE 
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THAT  HAVE  BEEN  MENTIONED  IN  THE  LITERATURE  ARE  EXAMINED,  AND 
DESIGN  CRITERIA  FOR  TERM  MATCHERS  ARE  DISCUSSED.  A NEW 
DESIGN  THAT  USES  A NONDETERMINISTIC  FINITE  STATE  AUTOMATON 
TO  CONTROL  MATCHING,  IS  INTRODUCED,  ITS  OPERATION  IS 
EXPAINED,  AND  THE  PRACTICALITY  OF  USING  IT  IN  A REAL  SYSTEM 
IS  DISCUSSED. 
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ABSTRACT: 

BOTH  SIMULATION  AND  ANALYTIC  MODELS  OF  COMPUTER  SYSTEMS  CAN 
BE  VERY  USEFUL  FOR  PREDICTING  THE  PERFORMANCE  OF  PROPOSED 
NEW  SYSTEMS  OR  PROPOSED  CHANGES  TO  EXISTING  SYSTEMS. 
UNFORTUNATELY,  MANY  POTENTIAL  USERS  OF  MODELS  ARE  RELUCTANT 
TO  USE  THEM  BECAUSE  OF  THE  COMPLEXITY  OF  MANY  SUCH  MODELS 
AND  THE  DIFFICULTY  OF  RELATING  THE  MODEL  TO  THE  REAL  SYSTEM. 
THIS  TUTORIAL  PAPER  LEADS  THE  READER  THROUGH  THE  DEVELOPMENT 
AND  USE  OF  AN  EASILY  UNDERSTOOD  ANALYTIC  MODEL.  THIS  IS  THEN 
PLACED  IN  CONTEXT  WITH  A CLASS  OF  SIMILAR  ANALYTIC  MODELS. 

IN  SPITE  OF  THE  SIMPLICITY  (UTILIZATION,  THROUGHPUT,  AND 
RESPONSE)  USING  ONLY  THE  MOST  BASIC  SYSTEM  DATA  AS  INPUT. 

THESE  PARAMETERS  CAN  EITHER  BE  ESTIMATES  OR  MEASUREMENTS 
FROM  A RUNNING  SYSTEM.  THE  MODEL  EQUATIONS  AND  ASSUMPTIONS 
ARE  DEFINED,  AND  A DETAILED  CASE  STUDY  IS  PRESENTED  AS  AN 
EXAMPLE  OF  THEIR  USE. 
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COMPUTER  PERFORMANCE  PREDICTION  * ANALYTIC  MODELS  * QUEUEING 
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ABSTRACT: 

DURING  RECENT  YEARS,  THERE  HAVE  BEEN  MANY  ATTEMPTS  TO  DEFINE 
AND  MEASURE  THE  "COMPLEXITY”  OF  A COMPUTER  PROGRAM.  MAURICE 
HALSTEAD  HAS  DEVELOPED  A THEORY  THAT  GIVES  OBJECTIVE 
MEASUREMENTS  OF  SOFTWARE  COMPLEXITY.  VARIOUS  STUDIES  AND 
EXPERIMENTS  HAVE  SHOWN  THAT  THE  THEORY’S  PREDICTIONS  OF  THE 
NUMBER  OF  BUGS  IN  PROGRAMS  AND  OF  THE  TIME  REQUIRED  TO 
IMPLEMENT  A PROGRAM  ARE  AMAZINGLY  ACCURATE.  IT  IS  A 
PROMISING  THEORY  WORTHY  OF  MUCH  MORE  PROBING  SCIENTIFIC 
INVESTIGATION.  THIS  PAPER  REVIEWS  THE  THEORY,  CALLED 
"SOFTWARE  SCIENCE”,  AND  THE  EVIDENCE  SUPPORTING  IT.  A BRIEF 
DESCRIPTION  OF  A RELATED  THEORY,  CALLED  "SOFTWARE  PHYSICS”, 

IS  INCLUDED. 
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ABSTRACT: 

COST-BENEFIT  ANALYSIS  OF  COMPUTER-BASED  INFORMATION  SYSTEMS 
IS  A MAJOR  CONCERN  OF  MANAGERS  IN  PUBLIC  AND  PRIVATE 
ORGANIZATIONS  USING  COMPUTERS.  THIS  PAPER  INTRODUCES  AND 
REVIEWS  BASIC  ELEMENTS  OF  COST-BENEFIT  ANALYSIS  AS  APPLIED 
TO  COMPUTERIZED  INFORxMATION  SYSTEMS,  AND  PROVIDES  DISCUSSION 
OF  THE  MAJOR  PROBLEMS  TO  BE  AVOIDED. 
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POPULAR  CLASS  OF  QUEUEING  NETWORK  MODELS.  THE  PROCEDURE 
MAKES  USE  OF  CURRENT  MEASUREMENT  MONITORS  AS  MUCH  AS 
POSSIBLE.  WE  SURVEY  THE  TWO  BASIC  APPROACHES  TO  MONITORING 
(HARDWARE,  SOFTWARE,  AND  HYBRID).  ALSO  SURVEYED  ARE 
MEASUREMENT  TOOLS  FOR  THE  ANALYTICAL  MODELING  OF  SEVERAL 
CURRENT  FAMILIES  OF  COMPUTER  SYSTEMS.  WE  DISCUSS  IN  DETAIL 
EXAMPLES  OF  MODEL  VALIDATION  AND  PERFORMANCE  PREDICTIONS  TO 
ILLUSTRATE  THE  MEASUREMENT  PROCEDURES  AND  THE  CLASS  OF 
MODELS. 
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VALIDATIONS  * PERFORMANCE  EVALUATION  * MEASUREMENTS  * 
MONITORS 

CATEGORIES: 

8.1  * 4.3 


*************************t*t**-**t****t***t*t***:tt********t*****t* 


REFERENCE  CODE:  71 

JOURNAL: 

ACM  COMPUTING  SURVEYS 
VOLUME:  11 

ISSUE:  4 

DATE:  DECEMBER  1979 
PAGES:  371  - 395 

TITLE: 

DATABASE  REORGANIZATION PRINCIPLES  AND  PRACTICE 

AUTHOR(s): 

SOCKUT,  GRAY  H.  * GOLDBERG,  ROBERT  P. 

AFFILIATION: 

INSTITUTE  FOR  COMPUTER  SCIENCES  AND  TECHNOLOGY.  NATIONAL 
BUREAU  OF  STANDARDS 

ABSTRACT: 

DATABASE  REORGANIZATION  CAN  BE  DEFINED  AS  CHANGING  SOME 
ASPECT  OF  THE  WAY  IN  WHICH  A DATABASE  IS  ARRANGED  LOGICALLY 
AND/OR  PHYSICALLY.  AN  EXAMPLE  IS  CHANGING  FROM  A ONE-TO-ONE 
TO  A ONE-TO-MANY  RELATIONSHIP.  REORGANIZATION  IS  A NECESSARY 
FUNCTION  IN  A DATABASE  SYSTEM.  THIS  PAPER  INTRODUCES  THE 
BASIC  CONCEPTS  OF  REORGANIZATION,  INCLUDING  WHY  IT  IS 
PERFORMED.  MANY  TYPES  OF  REORGANIZATION  ARE  DESCRIBED  AND 
CLASSIFIED  INTO  LOGICAL/PHYSICAL  LEVELS.  THEN  PRAGMATIC 
ISSUES  SUiTH  AS  REORGANIZATION  STRATEGIES,  A SURVEY  OF 
SEVERAL  COMMERCIAL  REORGANIZATION  FACILITIES,  CASE  STUDIES, 
AND  DATABASE  ADMINISTRATION  CONSIDERATIONS  ARE  COVERED. 
FINALLY,  SEVERAL  RESEARCH  EFFORTS  ARE  SURVEYED. 
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ABSTRACT: 

THE  CONCEPT  OF  AN  INTEGRATED  DICTIONARY/DIRECTORY  (D/D) 

SYSTEM  IS  DISCUSSED  IN  DETAIL,  AND  THE  STATE  OF  CURRENT 
SYSTEMS  IN  BOTH  THE  CENTRALIZED  AND  DISTRIBUTED  DATABASE 
ENVIRONMENTS  IS  SURVEYED.  FOR  THE  CENTRALIZED  DATABASE 
ENVIRONMENT,  THREE  ASPECTS  ARE  EMPHASIZED:  (l)  THE  SOFTWARE 
INTERFACES  BETWEEN  THE  D/D  SYSTEM  AND  OTHER  SOFTWARE 
PACKAGES,  (2)  THE  CONVERT  FUNCTION  OF  THE  D/D  SYSTEM,  AND 
(3)  THE  ENVIRONMENTAL  DEPENDENCY  BETWEEN  THE  D/D  SYSTEM  AND 
A DATABASE  MANAGEMENT  SYSTEM  (DBMS).  FOR  THE  DISTRIBUTED 
DATABASE  ENVIRONMENT,  THE  ARTICLE  ELUCIDATES  THE  NECESSARY 
EXTENSIONS  TO  THE  CENTRALIZED  D/D,  THE  ADDITIONAL  SOFTWARE 
INTERFACES  REQUIRED,  AND  THE  USE  OF  THE  D/D  AS  A DISTRIBUTED 
DATABASE.  AN  EXAMPLE  OF  A COMMERCIAL  D/D  SYSTEM  THAT  IS 
INTEGRATED  WITH  A DISTRIBUTED  DBMS  IS  PRESENTED. 
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ABSTRACT: 

THE  OPTIMAL  DISTRIBUTION  OF  FILES  AMONG  STORAGE  NODES  IS  A 
MAJOR  PROBLEM  IN  COMPUTER  SYSTEM  OPTIMIZATION.  DIFFERING 
DESIGN  GOALS,  VARYING  SYSTEM  ASSUMPTIONS,  AND  CONTRASTING 
SOLUTION  TECHNIQUES  YIELD  A DISPARITY  OF  OPTIMAL  FILE 
ASSIGNMENTS.  THIS  PAPER  VIEWS  THE  DIFFERING  FILE  ASSIGNMENT 
MODELS  IN  A UNIFORM  MANNER.  RELATIVE  ADVANTAGES  AND 
WEAKNESSES  OF  THE  VARIOUS  MODELS  BECOME  IMMEDIATELY 
APPARENT.  THIS  PERSPECTIVE  EXPOSES  THE  FURTHER  RESEARCH 
WHICH  IS  NECESSARY  IN  ORDER  TO  PROVIDE  A TRULY  SATISFACTORY 
SOLUTION  TO  THE  FILE  ASSIGNMENT  PROBLEM. 
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ABSTRACT: 

STRUCTURING  DATABASE  RECORDS  BY  CONSIDERING  DATA  ITEM  USAGE 
CAN  YIELD  SUBSTANTIAL  EFFICIENCIES  IN  THE  OPERATING  COST  OF 
DATABASE  SYSTEMS.  HOWEVER,  SINCE  THE  NUMBER  OF  POSSIBLE 
PHYSICAL  RECORD  STRUCTURES  FOR  DATABASE  OF  PRACTICAL 
SIGNIFICANCE  IS  ENORMOUS,  AND  THEIR  EVALUATION  IS  EXTREMELY 
COMPLEX  DETERMINING  EFFICIENT  RECORD  STRUCTURES  BY  FULL 
ENUMERATION  IS  GENERALLY  INFEASIBLE.  THIS  PAPER  DISCUSSES 
THE  TECHNIQUES  OF  MATHEMATICAL  CLUSTERING,  ITERATIVE 
GROUPING  REFINEMENT,  MATHEMATICAL  PROGRAMMING,  AND, 
HIERARCHIC  AGGREGATION,  WHICH  CAN  BE  USED  TO  QUICKLY 
DETERMINE  EFFICIENT  RECORD  STRUCTURES  FOR  LARGE,  SHARED 
DATABASES. 
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THE  PROBLEMS  OF  FILE  ALLOCATION  AND  CAPACITY  ASSIGNMENT  IN  A 
FIXED  TOPOLOGY  DISTRIBUTED  COMPUTER  NETWORK  ARE  EXAMINED. 
THESE  TWO  ASPECTS  OF  THE  DESIGN  ARE  TIGHTLY  COUPLED  BY  MEANS 
OF  AN  AVERAGE  MESSAGE  DELAY  CONSTRAINT.  THE  OBJECTIVE  IS  TO 
ALLOCATE  COPIES  OF  INFORMATION  FILES  TO  NETWORK  NODES  AND 
CAPACITIES  TO  NETWORK  LINKS  SO  THAT  A MINIMUM  COST  IS 
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ACHIEVED  SUBJECT  TO  NETWORK  DELAY  AND  FILE  AVAILABILITY 
CONSTRAINTS.  A MODEL  FOR  SOLVING  THE  PROBLEM  IS  FORMULATED 
AND  THE  RESULTING  OPTIMIZATION  PROBLEM  IS  SHOWN  TO  FALL  INTO 
A CLASS  OF  NONLINEAR  INTEGER  PROGRAMMING  PROBLEMS. 
DETERMINISTIC  TECHNIQUES  FOR  SOLVING  THIS  CLASS  OF  PROBLEMS 
ARE  COMPUTATIONALLY  CUMBERSOME,  EVEN  FOR  SMALL  SIZE 
PROBLEMS.  A NEW  HEURISTIC  ALGORITHM  IS  DEVELOPED,  WHICH  IS 
BASED  ON  A DECOMPOSITION  TECHNIQUE  THAT  GREATLY  REDUCES  THE 
COMPUTATIONAL  COMPLEXITY  OF  THE  PROBLEM.  NUMERICAL  RESULTS 
FOR  A VARIETY  OF  NETWORK  CONFIGURATIONS  INDICATE  THAT  THE 
HEURISTIC  ALGORITHM,  WHILE  NOT  THEORETICALLY  CONVERGENT, 
YIELDS  PRACTICABLE  LOW  COST  SOLUTIONS  WITH  SUBSTANTIAL 
SAVINGS  IN  COMPUTER  PROCESSING  TIME  AND  STORAGE 
REQUIREMENTS.  MOREOVER,  IT  IS  SHOWN  THAT  THIS  ALGORITHM  IS 
CAPABLE  OF  SOLVING  REALISTIC  NETWORK  PROBLEMS  WHOSE 
SOLUTIONS  USING  DETERMINISTIC  TECHNIQUES  ARE  COMPUTATIONALLY 
INTRACTABLE. 
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BUFFER  SPACE  IS  CREATED  AND  MANAGED  IN  DATABASE  SYSTEMS  IN 
ORDER  TO  REDUCE  ACCESSES  TO  THE  I/O  DEVICES  FOR  DATABASE 
INFORMATION.  IN  SYSTEMS  USING  VIRTUAL  MEMORY  ANY  INCREASE  IN 
THE  BUFFER  SPACE  MAY  BE  ACCOMPANIED  BY  AN  INCREASE  IN 
PAGING.  THE  EFFECTS  OF  THESE  FACTORS  ON  SYSTEM  PERFORMANCE 
ARE  QUANTIFIED  WHERE  SYSTEM  PERFORMANCE  IS  A FUNCTION  OF 
PAGE  FAULTS  AND  DATABASE  ACCESSES  TO  I/O  DEVICES.  THIS 
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PHENOMENON  IS  EXAMINED  THROUGH  THE  ANALYSIS  OF  EMPIRICAL 
DATA  GATHERED  IN  A MULTIFACTOR  EXPERIMENT.  THE  FACTORS 
CONSIDERED  ARE  MEMORY  SIZE,  SIZE  OF  BUFFER  SPACE,  MEMORY 
REPLACEMENT  ALGORITHM.  THE  IMPROVEMENT  OF  SYSTEM  PERFORMANCE 
THROUGH  AN  INCREASE  IN  THE  SIZE  OF  THE  BUFFER  SPACE  IS 
DEMONSTRATED.  IT  IS  ALSO  SHOWN  THAT  FOR  CERTAIN  VALUES  OF 
THE  OTHER  FACTORS  AN  INCREASE  IN  THE  SIZE  OF  THE  BUFFER 
SPACE  CAN  CAUSE  PERFORMANCE  TO  DETERIORATE. 
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ON  USER  CRITERIA  FOR  DATA  MODEL  EVALUATION 
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McGEE,  WILLIAM  C. 
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ABSTRACT: 

THE  EMERGENCE  OF  A DATABASE  TECHNOLOGY  IN  RECENT  YEARS  HAS 
FOCUSED  INTEREST  ON  THE  SUBJECT  OF  DATA  MODELS.  A DATA  MODEL 
IS  THE  CLASS  OF  LOGICAL  DATA  STRUCTURES  WHICH  A COMPUTER 
SYSTEM  OR  LANGUAGE  MAKES  AVAILABLE  TO  THE  USER  FOR  THE 
PURPOSE  OF  FORMULATING  DATA  PROCESSING  APPLICATIONS.  THE 
DIVERSITY  OF  COMPUTER  SYSTEMS  AND  LANGUAGES  HAS  RESULTED  IN 
A CORRESPONDING  DIVERSITY  OF  DATA  MODELS,  AND  HAS  CREATED  A 
PROBLEM  FOR  THE  USER  IN  SELECTING  A DATA  MODEL  WHICH  IS  IN 
SOME  SENSE  APPROPRIATE  TO  A GIVEN  APPLICATION.  AN  EVALUATION 
PROCEDURE  IS  NEEDED  WHICH  WILL  ALLOW  THE  USER  TO  EVALUATE 
ALTERNATIVE  MODELS  IN  THE  CONTEXT  OF  A SPECIFIC  SET  OF 
APPLICATIONS.  THIS  PAPER  TAKES  A FIRST  STEP  TOWARD  SUCH  A 
PROCEDURE  BY  IDENTIFYING  THE  ATTRIBUTES  OF  A DATA  MODEL 
WHICH  CAN  BE  USED  AS  CRITERIA  FOR  EVALUATION  THE  MODEL.  TWO 
KINDS  OF  CRITERIA  ARE  PRESENTED:  USE  CRITERIA,  WHICH  MEASURE 
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THE  USABILITY  OF  THE  MODEL;  AND  IMPLEMENTATION  CRITERIA, 

WHICH  MEASURE  THE  LMPLEMENTABILITY  OF  THE  MODEL  AND  THE 
EFFICIENCY  OF  THE  RESULTING  IMPLEMENTATION.  THE  USE  OF  THE 
CRITERIA  IS  ILLUSTRATED  BY  APPLYING  THEM  TO  THREE  SPECIFIC 
MODELS:  AN  N-ARY  RELATIONAL  MODEL,  A HIERARCHIC  MODEL,  AND  A 
NETWORK  MODEL. 
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ABSTRACT: 

A GENERALIZED  MODEL  FOR  PHYSICAL  DATABASE  ORGANIZATIONS  IS 
PRESENTED.  EXISTING  DATABASE  ORGANIZATIONS  ARE  SHOWN  TO  FIT 
EASILY  INTO  THE  MODEL  AS  SPECIAL  CASES.  GENERALIZED  ACCESS 
ALGORITHMS  AND  COST  EQUATIONS  ASSOCIATED  WITH  THE  MODEL  ARE 
DEVELOPED  AND  ANALYZED.  THE  MODEL  PROVIDES  A GENERAL  DESIGN 
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ABSTRACT: 

SECONDARY  INDEXES  ARE  OFTEN  USED  IN  DATABASE  MANAGEMENT 
SYSTEMS  FOR  SECONDARY  KEY  RETRIEVAL.  ALTHOUGH  THEIR  USE  CAN 
IMPROVE  RETRIEVAL  TIME  SIGNIFICANTLY,  THE  COST  OF  INDEX 
MAINTENANCE  AND  STORAGE  INCREASES  THE  OVERHEAD  OF  THE  FILE 
PROCESSING  APPLICATION.  THE  OPTIMAL  SET  OF  INDEXED  SECONDARY 
KEYS  FOR  A PARTICULAR  APPLICATION  DEPENDS  ON  A NUMBER  OF 
APPLICATION  DEPENDENT  FACTORS.  IN  THIS  PAPER  A COST  FUNCTION 
IS  DEVELOPED  FOR  THE  EVALUATION  OF  CANDIDATE  INDEXING 
CHOICES  AND  APPLIED  TO  THE  OPTIMIZATION  OF  INDEX  SELECTION. 
FACTORS  ACCOUNTED  FOR  INCLUDE  FILE  SIZE,  THE  RELATIVE  RATES 
OF  RETRIEVAL  AND  MAINTENANCE  OVER  THE  CANDIDATE  KEYS,  INDEX 
STRUCTURE,  AND  SYSTEM  CHARGING  RATES.  AMONG  THE  RESULT 
DEMONSTRATED  ARE  THE  INCREASED  EFFECTIVENESS  OF  SECONDARY 
INDEXES  FOR  LARGE  FILE,  THE  EFFECT  OF  THE  RELATIVE  RATES  OF 
RELATIVE  RATES  OF  RETRIEVAL  AND  MAINTENANCE  THE  GREATER  COST 
OF  ALLOWING  FOR  ARBITRARILY  FORMULATED  QUERIES,  AND  THE 
IMPACT  ON  COST  OF  THE  USE  OF  DIFFERENT  INDEX  STRUCTURES. 

KEYWORDS: 

SECONDARY  INDEX  * SECONDARY  KEY  * INVERTED  INDEX  » INVERTED 
FILE  * SECONDARY  KEY  ACCESS  * DATABASE  * DATA  MANAGEMENT  * 
FILE  DESIGN  » RETRIEVAL  ♦ OPTIMIZATION  * ACCESS  METHODS  * 

ACCESS  PATH  * BOOLEAN  QUERY  » COST  FUNCTION 

CATEGORIES: 

3.50  * 3.72  * 3.74  » 4.33  » 434 

******************t*t****************************t***********t*** 

REFERENCE  CODE:  80 

JOURNAL: 


- 47  - 


TODS 

VOLUME:  2 

ISSUE:  2 

DATE:  JUNE  1977 
PAGES:  175  - 195 

TITLE: 

PERFORMANCE  EVALUATION  OF  A RELATIONAL  ASSOCIATIVE  PROCESSOR 
AUTHOR(s): 

OZKARAHAN,  E.  A.  * SCHUSTER,  S.  A.  * SEVCIK,  K.  C. 

AFFILIATION: 

UNIVERSITY  OF  TORONTO,  CANADA 
ABSTRACT: 

AN  ASSOCIATIVE  PROCESSOR  CALLED  RAP  HAS  BEEN  DESIGNED  TO 
PROVIDE  HARDWARE  SUPPORT  FOR  THE  USE  AND  MANIPULATION  OF 
DATABASES.  RAP  IS  PARTICULARLY  SUITED  FOR  SUPPORTING 
RELATIONAL  DATABASES.  IN  THIS  PAPER,  THE  RELATIONAL 
OPERATIONS  PROVIDED  BY  THE  RAP  HARDWARE  ARE  DESCRIBED,  AND  A 
REPRESENTATIVE  APPROACH  TO  PROVIDING  THE  SAME  RELATIONAL 
OPERATIONS  WITH  CONVENTIONAL  SOFTWARE  AND  HARDWARE  IS 
DEVISED.  ANALYTIC  MODELS  ARE  CONSTRUCTED  FOR  RAP  AND  THE 
CONVENTIONAL  SYSTEM.  THE  EXECUTION  TIMES  OF  SEVERAL  OF  THE 
OPERATIONS  ARE  SHOWN  TO  BE  VASTLY  IMPROVED  WITH  RAP  FOR 
LARGE  RELATIONS. 
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ABSTRACT: 

BUFFER  POOLS  ARE  CREATED  AND  MANAGED  IN  DATABASE  SYSTEMS  IN 
ORDER  TO  REDUCE  THE  TOTAL  NUMBER  OF  ACCESSES  TO  THE  I/O 
DEVICES.  IN  SYSTEMS  USING  VIRTUAL  MEMORY,  ANY  REDUCTION  IN 
I/O  ACCESSES  MAY  BE  ACCOMPANIED  BY  AN  INCREASE  IN  PAGING. 

THE  EFFECTS  OF  THESE  FACTORS  ON  SYSTEM  PERFORMANCE  ARE 
QUANTIFIED,  WHERE  SYSTEM  PERFORMANCE  IS  A FUNCTION  OF  PAGE 
FAULTS  AND  DATABASE  ACCESSES  TO  THE  I/O  DEVICES.  A PREVIOUS 
STUDY  OF  THIS  PHENOMENON  IS  EXTENDED  THROUGH  THE  ANALYSIS  OF 
EMPIRICAL  DATA  GATHERED  IN  A MULTIFACTOR  EXPERIMENT.  IN  THIS 
STUDY  MEMORY  IS  PARTITIONED  BETWEEN  THE  PROGRAM  AND  THE 
BUFFER  SO  THAT  THE  IMPACT  OF  THE  CONTROLLED  FACTORS  CAN  BE 
MORE  EFFECTIVELY  EVALUATED.  IT  IS  POSSIBLE  TO  IMPROVE  SYSTEM 
PERFORMANCE  THROUGH  THE  USE  OF  DIFFERENT  PAGING  ALGORITHMS 
IN  THE  PROGRAM  PARTITION  AND  THE  BUFFER  PARTITION.  ALSO,  THE 
EFFECTS  ON  SYSTEM  PERFORMANCE  AS  THE  VIRTUAL  BUFFER  SIZE  IS 
INCREASED  BEYOND  THE  REAL  MEMORY  ALLOCATED  TO  THE  BUFFER 
PARTITION  ARE  INVESTIGATED. 
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AN  INFERENTIAL  RELATIONAL  SYSTEM  IS  ONE  IN  WHICH  DATA  IN  THE 
SYSTEM  CONSISTS  OF  BOTH  EXPLICIT  FACTS  AND  GENERAL  AXIOMS 
(OR  ’’VIEWS”).  THE  GENERAL  AXIOMS  ARE  USED  TOGETHER  WITH  THE 
EXPLICIT  FACTS  TO  DERIVE  THE  FACTS  THAT  ARE  IMPLICIT 
(VIRTUAL  RELATIONS)  WITHIN  THE  SYSTEM.  A TOP-DOWN  ALGORITHM, 
AS  USED  IN  ARTIFICIAL  INTELLIGENCE  WORK,  IS  DESCRIBED  TO 
DEVELOP  INFERENCES  WITHIN  THE  SYSTEM.  THE  TOP-DOWN  APPROACH 
STARTS  WITH  THE  QUERY,  A CONJUNCTION  OF  RELATIONS,  TO  BE 
ANSWERED.  EITHER  A RELATIONAL  FACT  SOLVES  A GIVEN  RELATION 
IN  A CONJUNCT,  OR  THE  RELATION  IS  REPLACED  BY  A CONJUNCT  OF 
RELATIONS  WHICH  MUST  BE  SOLVED  TO  SOLVE  THE  GIVEN  RELATION. 
THE  APPROACH  REQUIRES  THAT  ONE  AND  ONLY  ONE  RELATION  IN  A 
CONJUNCTION  BE  REPLACED  (OR  EXPANDED)  BY  THE  GIVEN  FACTS  AND 
GENERAL  AXIOMS.  THE  DECISION  TO  EXPAND  ONLY  A SINGLE 
RELATION  IS  TERMED  A SELECTION  FUNCTION.  IT  IS  SHOWN  FOR 
RELATIONAL  SYSTEMS  THAT  SUCH  A RESTRICTION  STILL  GUARANTEES 
THAT  A SOLUTION  TO  THE  PROBLEM  WILL  BE  FOUND  IF  ONE  EXISTS. 
THE  ALGORITHM  PROVIDES  FOR  HEURISTIC  DIRECTION  IN  THE  SEARCH 
PROCESS.  EXPERIMENTAL  RESULTS  ARE  PRESENTED  WHICH  ILLUSTRATE 
THE  TECHNIQUES.  A BOOKKEEPING  MECHANISM  IS  DESCRIBED  WHICH 
PERMITS  ONE  TO  KNOW  WHEN  SUBPROBLEMS  ARE  SOLVED.  IT  FURTHER 
FACILITATES  THE  OUTPUTING  OF  REASONS  FOR  THE  DEDUCTIVELY 
FOUND  ANSWER  IN  A COHERENT  FASHION. 
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ABSTRACT: 

THE  PROBLEM  OF  FINDING  OPTIMAL  REORGANIZATION  INTERVALS  FOR 
LINEARLY  GROWING  FILES  IS  SOLVED.  AN  APPROXIMATE 
REORGANIZATION  POLICY,  INDEPENDENT  OF  FILE  LIFETIME,  IS 
OBTAINED.  BOTH  THE  OPTIMUM  AND  APPROXIMATE  POLICIES  ARE 
COMPARED  TO  PREVIOUSLY  PUBLISHED  RESULTS  USING  A NUMERICAL 
EXAMPLE. 
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ABSTRACT: 

CASDAL  IS  A HIGH  LEVEL  DATA  LANGUAGE  DESIGNED  AND 
IMPLEMENTED  FOR  THE  DATABASE  MACHINE  CASSM.  THE  LANGUAGE  IS 
USED  FOR  THE  MANIPULATION  AND  MAINTENANCE  OF  A DATABASE 
USING  AN  UNNORMALIZED  (HIERARCHICALLY  STRUCTURED)  RELATIONAL 
DATA  MODEL.  IT  ALSO  HAS  FACILITIES  TO  DEFINE,  MODIFY,  AND 
MAINTAIN  THE  DATA  MODEL  DEFINITION.  THE  UNIQUENESS  OF  CASDAL 
LIES  IN  ITS  POWER  TO  SPECIFY  COMPLEX  OPERATIONS  IN  TERMS  OF 
SEVERAL  NEW  LANGUAGE  CONSTRUCTS  AND  ITS  CONCEPT  OF  TAGGING 
OR  MARKING  TUPLES  AND  OF  MATCHING  VALUES  WHEN  WALKING  FROM 
RELATION  TO  RELATION.  THE  LANGUAGE  IS  A RESULT  OF  A TOP-DOWN 
DESIGN  AND  DEVELOPMENT  EFFORT  FOR  A DATABASE  MACHINE  IN 
WHICH  HIGH  LEVEL  LANGUAGE  CONSTRUCTS  ARE  DIRECTLY  SUPPORTED 
BY  THE  HARDWARE.  THIS  PAPER  (l)  GIVES  JUSTIFICATIONS  FOR  THE 
USE  OF  AN  UNNORMALIZED  RELATIONAL  MODEL  ON  WHICH  THE 
LANGUAGE  IS  BASED,  (2)  PRESENTS  THE  CASDAL  LANGUAGE 
CONSTRUCTS  WITH  EXAMPLES,  AND  (3)  DESCRIBES  CASSM’S 
ARCHITECTURE  AND  FACILITATE  THE  TRANSLATION  PROCESS.  THIS 
PAPER  ALSO  ATTEMPTS  TO  SHOW  HOW  THE  EFFICIENCY  OF  THE 
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LANGUAGE  AND  THE  TRANSLATION  TASK  CAN  BE  ACHIEVED  AND 
SIMPLIFIED  IN  A SYSTEM  IN  WHICH  THE  LANGUAGE  IS  THE  RESULT 
OF  A TOP-DOWN  SYSTEM  DESIGN  AND  DEVELOPMENT. 
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ABSTRACT: 

THE  WIDESPREAD  DISSEMINATION  OF  COMPUTER  AND  INFORMATION 
SYSTEMS  TO  NONTECHNICALLY  TRAINED  INDIVIDUALS  REQUIRES  A NEW 
APPROACH  TO  THE  DESIGN  AND  DEVELOPMENT  OF  DATABASE 
INTERFACES.  THIS  PAPER  PROVIDES  THE  MOTIVATIONAL  BACKGROUND 
FOR  CONTROLLED  PSYCHOLOGICAL  EXPERIMENTATION  IN  EXPLORING 
THE  PERSON/MACHINE  INTERFACE.  FRAMEWORKS  FOR  THE 
REDUCTIONIST  APPROACH  ARE  GIVEN,  RESEARCH  METHODS  DISCUSSED, 
RESEARCH  ISSUES  PRESENTED,  AND  A SMALL  EXPERIMENT  IS  OFFERED 
AS  AN  EXAMPLE  OF  WHAT  CAN  BE  ACCOMPLISHED.  THIS  EXPERIMENT 
IS  A COMPARISON  OF  NATURAL  AND  ARTIFICIAL  LANGUAGE  QUERY 
FACILITIES.  ALTHOUGH  SUBJECTS  POSED  APPROXIMATELY  EQUAL 
NUMBERS  OF  VALID  QUERIES  WITH  EITHER  FACILITY,  NATURAL 
LANGUAGE  USERS  MADE  SIGNIFICANTLY  MORE  INVALID  QUERIES  WHICH 
COULD  NOT  BE  ANSWERED  FROM  THE  DATABASE  THAT  WAS  DESCRIBED. 
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ABSTRACT: 

GIVEN  A FILE  ON  A SECONDARY  STORE  IN  WHICH  EACH  RECORD  HAS 
SEVERAL  ATTRIBUTES,  IT  IS  USUALLY  ADVANTAGEOUS  TO  BUILD  AN 
INDEX  MECHANISM  TO  DECREASE  THE  COST  OF  CONDUCTING 
TRANSACTIONS  TO  THE  FILE.  THE  PROBLEM  OF  SELECTING 
ATTRIBUTES  OVER  WHICH  TO  INDEX  HAS  BEEN  STUDIED  IN  THE 
CONTEXT  OF  VARIOUS  STORAGE  STRUCTURES  AND  ACCESS 
ASSUMPTIONS.  ONE  ALGORITHM  TO  MAKE  AN  OPTIMUM  INDEX 
SELECTION  REQUIRES  2**K  STEPS  IN  THE  WORST  CASE,  WHERE  K IS 
THE  NUMBER  OF  ATTRIBUTES  IN  THE  FILE.  WE  EXAMINE  THE 
QUESTION  OF  WHETHER  A MORE  EFFICIENT  ALGORITHM  MIGHT  EXIST 
AND  SHOW  THAT  EVEN  UNDER  A SIMPLE  COST  CRITERION  THE  PROBLEM 
IS  COMPUTATIONALLY  DIFFICULT  IN  A PRECISE  SENSE.  OUR  RESULTS 
EXTEND  DIRECTLY  TO  OTHER  RELATED  PROBLEMS  WHERE  THE  COST  OF 
INDEX  DEPENDS  ON  FIXED  VALUES  WHICH  ARE  ASSIGNED  TO  EACH 
ATTRIBUTE.  SOME  PRACTICAL  IMPLICATIONS  ARE  DISCUSSED. 
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A MODEL  OF  DATABASE  STORAGE  AND  ACCESS  IS  PRESENTED.  THE 
MODEL  REPRESENTS  MANY  EVALUATION  ALGORITHMS  AS  SPECIAL 
CASES,  AND  HELPS  TO  BREAK  A COMPLEX  ALGORITHM  INTO  SIMPLE 
ACCESS  OPERATIONS.  GENERALIZED  ACCESS  COST  EQUATIONS 
ASSOCIATED  WITH  THE  MODEL  ARE  DEVELOPED  AND  ANALYZED. 
OPTIMIZATION  OF  THESE  COST  EQUATIONS  YIELDS  AN  OPTIMAL 
ACCESS  ALGORITHM  WHICH  CAN  BE  SYNTHESIZED  BY  A QUERY  SYSTEM 
WHOSE  DESIGN  IS  BASED  ON  THE  MODULAR  ACCESS  OPERATIONS. 

KEYWORDS: 

RELATIONAL  DATA  MODEL  * QUERY  LANGUAGE  * DATA  MANIPULATION 
LANGUAGE  ? QUERY  OPTIMIZATION  * DATABASE  OPTIMIZATION  * 
INVERTED  FILE 

CATEGORIES: 

3.70  * 3.72  * 3.74  • 4.33 

REFERENCE  CODE:  88 

JOURNAL: 

TODS 

VOLUME:  4 

ISSUE:  2 

DATE:  JUNE  1979 
PAGES:  228  - 239 

TITLE: 

PARTIAL-MATCH  HASH  CODING:  BENEFITS  OF  REDUNDANCY 
AUTHOR(s): 

BURKHARD,  WALTER  A. 

AFFILIATION: 

UNIVERSITY  OF  CALIFORNIA  AT  SAN  DIEGO 
ABSTRACT: 

FILE  DESIGNS  SUITABLE  FOR  RETRIEVAL  FROM  A FILE  OF  K-FIELD 


- 54  - 


RECORDS  WHEN  QUERIES  MAY  BE  PARTIALLY  SPECIFIED  ARE 
EXAMINED.  STORAGE  REDUNDANCY  IS  INTRODUCED  TO  OBTAIN 
IMPROVED  WORST-CASE  AND  AVERAGE-CASE  PERFORMANCES.  THE 
RESULTING  STORAGE  SCHEMES  ARE  APPROPRIATE  FOR  REPLICATED 
DISTRIBUTED  DATABASE  ENVIRONMENTS;  IT  IS  POSSIBLE  TO  IMPROVE 
THE  OVERALL  AVERAGE  AND  WORST-CASE  BEHAVIOR  FOR  QUERY 
RESPONSE  AS  WELL  AS  PROVIDE  AN  ENVIRONMENT  WITH  VERY  HIGH 
RELIABILITY.  WITHIN  PRACTICAL  SYSTEMS  IT  WILL  BE  POSSIBLE  TO 
IMPROVE  THE  QUERY  RESPONSE  TIME  PERFORMANCE  AS  WELL 
RELIABILITY  OVER  COMPARABLE  SYSTEMS  WITHOUT  REPLICATION. 
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A MODIFIED  VERSION  OF  THE  MULTIPLE  ATTRIBUTE  TREE  (MAT) 
DATABASE  ORGANIZATION,  WHICH  USES  A COMPACT  DIRECTORY,  IS 
DISCUSSED.  AN  EFFICIENT  ALGORITHM  TO  PROCESS  THE  DIRECTORY 
FOR  CARRYING  OUT  THE  NODE  SEARCHES  IS  PRESENTED.  STATISTICAL 
PROCEDURES  ARE  DEVELOPED  TO  ESTIMATE  THE  NUMBER  OF  NODES 
SEARCHED  AND  THE  NUMBER  OF  DATA  BLOCKS  RETRIEVED  FOR  MOST 
GENERAL  AND  COMPLEX  QUERIES.  THE  PERFORMANCE  OF  INVERTED 
FILE  AND  MODIFIED  MAT  ORGANIZATIONS  ARE  COMPARED  USING  SIX 
REAL-LIFE  DATABASES  AND  FOUR  TYPES  OF  QUERY  COMPLEXITIES. 
CAREFUL  TRADEOFFS  ARE  ESTABLISHED  IN  TERMS  OF  STORAGE  AND 
ACCESS  TIMES  FOR  DIRECTORY  AND  DATA,  QUERY  COMPLEXITIES,  AND 
DATABASE  CHARACTERISTICS. 
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TWO  EXPERIMENTS  TESTING  THE  ABILITY  OF  SUBJECTS  TO  WRITE 
QUERIES  IN  TWO  DIFFERENT  QUERY  LANGUAGES  WERE  RUN.  THE  TWO 
LANGUAGES,  AQL  AND  TABLET,  DIFFER  PRIMARILY  IN  THEIR 
PROCEDURALITY;  BOTH  LANGUAGES  USE  THE  RELATIONAL  DATA  MODEL, 
AND  THEIR  HALSTEAD  LEVELS  ARE  SIMILAR.  CONSTRUCTS  IN  THE 
LANGUAGES  WHICH  DO  NOT  AFFECT  THEIR  PROCEDURALITY  ARE 
IDENTICAL.  THE  TWO  LANGUAGES  WERE  LEARNED  BY  THE 
EXPERIMENTAL  SUBJECTS  ALMOST  EXCLUSIVELY  FORM  MANUALS 
PRESENTING  THE  SAME  EXAMPLES  AND  PROBLEMS  ORDERED 
IDENTICALLY  FOR  BOTH  LANGUAGES.  THE  RESULTS  OF  THE 
EXPERIMENTS  SHOW  THAT  SUBJECTS  USING  THE  MORE  PROCEDURAL 
LANGUAGE  WROTE  DIFFICULT  QUERIES  BETTER  THAN  SUBJECTS  USING 
THE  LESS  PROCEDURAL  LANGUAGE.  THE  RESULTS  OF  THE  EXPERIMENTS 
ARE  USED  TO  COMPARE  CORRESPONDING  CONSTRUCTS  IN  THE  TWO 
LANGUAGES  AND  TO  RECOMMEND  IMPROVEMENTS  FOR  THESE 
CONSTRUCTS. 
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OPTIMAL  FILE  DESIGNS  AND  REORGANIZATION  POINTS 
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BATORY,  D.  S. 

AFFILIATION: 

UNIVERSITY  OF  TORONTO 

ABSTRACT: 

A MODEL  FOR  STUDYING  THE  COMBINED  PROBLEMS  OF  FILE  DESIGN 
AND  FILE  ORGANIZATION  IS  PRESENTED.  NEW  MODELING  TECHNIQUES 
FOR  PREDICTING  THE  PERFORMANCE  EVOLUTION  OF  FILES  AND  FOR 
FINDING  OPTIMAL  REORGANIZATION  POINTS.  FOR  FILES  ARE 
INTRODUCED.  APPLICATIONS  OF  THE  MODEL  TO  HASH-BASED  AND 
INDEXED-SEQUENTIAL  FILES  REVEAL  IMPORTANT  RELATIONSHIPS 
BETWEEN  INITIAL  LOADING  FACTORS  AND  REORGANIZATION 
FREQUENCY.  A PRACTICAL  FILE  DESIGN  STRATEGY.  BASED  ON  THESE 
RELATIONSHIPS,  IS  PROPOSED. 
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AUTHOR(s): 

LARSON,  PER-AKE 

AFFILIATION: 

ABO  AKADEMI,  FINLAND 

ABSTRACT: 

LINEAR  HASHING  WITH  PARTIAL  EXPANSIONS  IS  A NEW  FILE 
ORGANIZATION  PRIMARILY  INTENDED  FOR  FILES  WHICH  GROW  AND 
SHRINK  DYNAMICALLY.  THIS  PAPER  PRESENTS  A MATHEMATICAL 
ANALYSIS  OF  THE  EXPECTED  PERFORMANCE  OF  THE  NEW  SCHEME.  THE 
FOLLOWING  PERFORMANCE  MEASURES  ARE  CONSIDERED:  LENGTH  OF 
SUCCESSFUL  AND  UNSUCCESSFUL  SEARCHES,  ACCESSES  REQUIRED  TO 
INSERT  OR  DELETE  A RECORD,  AND  THE  SIZE  OF  THE  OVERFLOW 
AREA.  THE  PERFORMANCE  IS  CYCLICAL.  FOR  ALL  PERFORMANCE 
MEASURES,  THE  NECESSARY  FORMULAS  ARE  DERIVED  FOR  COMPUTING 
THE  EXPECTED  PERFORMANCE  AT  ANY  POINT  OF  A CYCLE  AND  THE 
AVERAGE  OVER  A CYCLE.  FURTHERMORE,  THE  EXPECTED  WORST  CASE 
IN  CONNECTION  WITH  SEARCHING  IS  ANALYZED.  THE  OVERALL 
PERFORMANCE  DEPENDS  ON  SEVERAL  FILE  PARAMETERS.  THE 
NUMERICAL  RESULTS  SHOW  THAT  FOR  MANY  REALISTIC  PARAMETER 
COMBINATIONS  THE  PERFORMANCE  IS  EXPECTED  TO  BE  EXTREMELY 
GOOD.  EVEN  THE  LONGEST  SEARCH  IS  EXPECTED  TO  BE  OF  QUITE 
REASONABLE  LENGTH. 


KEYWORDS: 

ALGORITHMS  * PERFORMANCE  * HASHING  * DYNAMIC  HASHING  SCHEMES 
* LINEAR  HASHING  * EXTENDIBLE  HASHING 

CATEGORIES: 

3.73  * 3.74 


REFERENCE  CODE:  93 

JOURNAL: 

TODS 

VOLUME:  7 

ISSUE:  4 

DATE;  DECEMBER  1982 
PAGES:  ,615  - 631 


TITLE: 

MATHEMATICAL  MODELS  OF  DATABASE  DEGRADATION 

AUTHOR(s): 

HEYMAN,  DANIEL  P. 

AFFILIATION: 

BELL  LABORATORIES 

ABSTRACT: 


- 58  - 


AS  DATA  ARE  UPDATED,  THE  INITIAL  PHYSICAL  STRUCTURE  OF  A 
DATABASE  IS  CHANGED  AND  RETRIEVAL  OF  SPECIFIC  PIECES  OF  DATA 
BECOMES  MORE  TIME  CONSUMING.  THIS  PHENOMENON  IS  CALLED 
DATABASE  DEGRADATION.  IN  THIS  PAPER  TWO  MODELS  OF  DATABASE 
DEGRADATION  ARE  DESCRIBED.  EACH  MODEL  REFERS  TO  A DIFFERENT 
ASPECT  OF  THE  PROBLEM.  IT  IS  ASSUMED  THAT  TRANS.ACTIONS  ARE 
STATISTICALLY  INDEPENDENT  AND  EITHER  ADD.  DELETE,  OR  UPDATE 
DATA.  THE  FIRST  MODEL  EXAMINES  THE  TIME  DURING  WHICH  A BLOCK 
OF  DATA  IS  FILLING  UP.  THE  SECOND  MODEL  EXAMINES  THE 
OVERFLOWS  FROM  A BLOCK  OF  DATA,  WHICH  ESSENTIALLY  DESCRIBES 
THE  BUILDUP  OF  DISORGANIZATION.  ANALYTICAL  RESULTS  ARE 
OBTAINED  FOR  BOTH  MODELS.  IN  ADDITION,  SEVERAL  NUMERICAL 
EXAMPLES  ARE  PRESENTED  WHICH  SHOW  THAT  THE  MEAN  NUMBER  OF 
OVERFLOWS  GROWS  APPROXIMATELY  LINEARLY  WITH  TIME.  THIS 
APPROXIMATION  IS  USED  TO  DEVISE  A SIMPLE  FORMULA  FOR  THE 
OPTIMAL  TIME  TO  REORGANIZE  A STOCHASTICALLY  GROWING  DATABASE 
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ABSTRACT: 

THE  NEED  FOR  ROBUST  RECOVERY  FACILITIES  IN  MODERN  DATABASE 
MANAGEMENT  SYSTEMS  IS  QUITE  WELL  KNOWN.  VARIOUS  AUTHORS  HAVE 
ADDRESSED  RECOVERY  FACILITIES  AND  SPECIFIC  TECHNIQUES,  BUT 
NONE  HAVE  DELVED  INTO  THE  PROBLEM  OF  RECOVERY  IN  DATABASE 
MACHINES.  IN  THIS  PAPER,  THE  TYPES  OF  UNDESIRABLE  EVENTS 
THAT  OCCUR  IN  A DATABASE  ENVIRONMENT  ARE  CLASSIFIED  AND  THE 
NECESSARY  RECOVERY  INFORMATION,  WITH  SUBSEQUENT  ACTIONS  TO 
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RECOVER  THE  CORRECT  STATE  OF  THE  DATABASE.  IS  SUMMARIZED.  A 
MODEL  OF  THE  "PROCESSOR-  PER-TRACK”  CLASS  OF  PARALLEL 
ASSOCIATIVE  DATABASE  PROCESSOR  IS  PRESENTED.  THREE  DIFFERENT 
TYPES  OF  RECOVERY  MECHANISMS  THAT  MAY  BE  CONSIDERED  FOR 
PARALLEL  ASSOCIATIVE  DATABASE  PROCESSORS  ARE  IDENTIFIED.  FOR 
EACH  ARCHITECTURE,  BOTH  THE  WORKLOAD  IMPOSED  BY  THE  RECOVERY 
MECHANISMS  ON  THE  EXECUTION  OF  DATABASE  OPERATIONS  (I.E., 
RETRIEVE,  MODIFY,  DELETE,  AND  INSERT)  AND  THE  WORKLOAD 
INVOLVED  IN  THE  RECOVERY  ACTIONS  (I.E.,  ROLLBACK,  RESTART. 
RESTORE,  AND  RECONSTRUCT)  ARE  ANALYZED.  THE  PERFORMANCE  OF 
THE  THREE  ARCHITECTURES  IS  QUANTITATIVELY  COMPARED.  THIS 
COMPARISON  IS  MADE  IN  TERMS  OF  THE  NUMBER  OF  EXTRA 
REVOLUTIONS  OF  THE  DATABASE  AREA  REQUIRED  TO  PROCESS  A 
TRANSACTION  VERSUS  THE  NUMBER  OF  RECORDS  AFFECTED  BY  A 
TRANSACTION.  A VARIETY  OF  DIFFERENT  DESIGN  PARAMETERS  OF  THE 
DATABASE  PROCESSOR,  OF  THE  DATABASE,  AND  OF  A MIX  OF 
TRANSACTION  TYPES  (MODIFY,  INSERT,  AND  DELETE)  ARE 
CONSIDERED.  A LARGE  NUMBER  OF  COMBINATIONS  IS  SELECTED  AND 
THE  EFFECTS  OF  THE  PARAMETERS  ON  THE  EXTRA  PROCESSING  TIME 
ARE  IDENTIFIED. 
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ABSTRACT: 

THE  AUTOMATIC  CORRECTION  OF  MISSPELLED  INPUTS  IS  DISCUSSED 
FROM  A VIEWPOINT  OF  SIMILAR-STRING  MATCHING.  FIRST  A 
HIERARCHICAL  FILE  ORGANIZATION  BASED  ON  A LINEAR  ORDERING  OF 
RECORDS  IS  PRESENTED  FOR  RETRIEVING  RECORDS  HIGHLY  SIMILAR 
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TO  ANY  INPUT  QUERY.  THEN  THE  SPELLING  PROBLEM  IS  ATTACKED  BY 
CONSTRUCTING  A HIERARCHICAL  FILE  FOR  A SET  OF  STRINGS  IN  A 
DIRECTORY  OF  ENGLISH  WORDS.  THE  SPELLING  CORRECTION  STEPS 
PROCEED  AS  FOLLOWS:  (l)  FIND  ONE  OF  THE  BEST-MATCH  STRINGS 
WHICH  ARE  MOST  SIMILAR  TO  A QUERY,  (2)  EXPAND  THE  SEARCH 
AREA  FOR  OBTAINING  THE  GOOD-MATCH  STRINGS,  AND  (3)  INTERRUPT 
THE  FILE  SEARCH  AS  SOON  AS  THE  REQUIRED  STRING  IS  DISPLAYED. 
COMPUTATIONAL  EXPERIMENTS  VERIFY  THE  PERFORMANCE  OF  THE 
PROPOSED  METHODS  FOR  SIMILAR  STRING  MATCHING  UNDER  THE  UNIX 
TIME-SHARING  SYSTEM. 
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INDEXING  AND  RETRIEVAL  STRATEGIES  FOR  NATURAL  LANGUAGE  FACT 
RETRIEVAL 
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KOLODNER,  JANET  L. 
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ABSTRACT: 

RESEARCHERS  IN  ARTIFICIAL  INTELLIGENCE  HAVE  RECENTLY  BECOME 
INTERESTED  IN  NATURAL  LANGUAGE  FACT  RETRIEVAL;  CURRENTLY, 
THEIR  RESEARCH  IS  AT  A POINT  WHERE  IT  CAN  BEGIN  CONTRIBUTING 
TO  THE  FIELD  OF  INFORMATION  RETRIEVAL.  IN  THIS  PAPER, 

STRATEGIES  FORA  NATURAL  LANGUAGE  FACT  RETRIEVAL  SYSTEM  ARE 
MAPPED  OUT.  AND  APPROACHES  TO  MANY  OF  THE  ORGANIZATION  AND 
RETRIEVAL  PROBLEMS  ARE  PRESENTED.  THE  CYRUS  SYSTEM,  WHICH 
KEEPS  TRACK  OF  IMPORTANT  PEOPLE  AND  IS  QUERIED  IN  ENGLISH, 

IS  PRESENTED  AND  USED  TO  ILLUSTRATE  THOSE  SOLUTIONS. 
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ABSTRACT: 

WE  CONSIDER  THE  PROBLEM  OF  DESIGNING  AN  INFORMATION 
RETRIEVAL  SYSTEM  ON  WHICH  PARTIAL  MATCH  QUERIES  HAVE  TO  BE 
ANSWERED.  EACH  RECORD  IN  THE  SYSTEM  CONSISTS  OF  A LIST  OF 
ATTRIBUTES,  AND  A PARTIAL  MATCH  QUERY  SPECIFIES  THE  VALUES 
OF  SOME  OF  THE  ATTRIBUTES.  THE  RECORDS  ARE  STORED  IN  BUCKETS 
IN  A SECONDARY  MEMORY,  AND  IN  ORDER  TO  ANSWER  A PARTIAL 
MATCH  QUERY  ALL  THE  BUCKETS  THAT  MAY  CONTAIN  A RECORD 
SATISFYING  THE  SPECIFICATIONS  OF  THE  QUERY  MUST  BE 
RETRIEVED.  THE  BUCKET  IN  WHICH  A GIVEN  RECORD  IS  STORED  IS 
FOUND  BY  MULTIPLE  KEY  HASHING  FUNCTION,  WHICH  MAPS  EACH 
ATTRIBUTE  TO  A STRING  OF  A FIXED  NUMBER  OF  BITS.  THE  ADDRESS 
OF  THAT  BUCKET  IS  THEN  REPRESENTED  BY  THE  STRING  OBTAINED  BY 
CONCATENATING  THE  STRINGS  ON  WHICH  THE  VARIOUS  ATTRIBUTES 
WERE  MAPPED.  A PARTIAL  MATCH  QUERY  MAY  SPECIFY  ONLY  PART  OF 
THE  BITS  IN  THE  STRING  REPRESENTING  THE  ADDRESS,  AND  THE 
LARGER  THE  THE  NUMBER  OF  BITS  SPECIFIED,  THE  SMALLER  THE 
NUMBER  OF  BUCKETS  THAT  HAVE  TO  BE  RETRIEVED  IN  ORDER  TO 
ANSWER  THE  QUERY.  THE  OPTIMIZATION  PROBLEM  CONSIDERED  IN 
THIS  PAPER  IS  THAT  OF  DECIDING  TO  HOW  MANY  BITS  EACH 
ATTRIBUTE  SHOULD  BE  MAPPED  BY  THE  HASHING  FUNCTION  ABOVE,  SO 
THAT  THE  EXPECTED  NUMBER  OF  BUCKETS  RETRIEVED  PER  QUERY  IS 
MINIMIZED.  EFFICIENT  SOLUTIONS  FOR  SPECIAL  CASES  OF  THIS 
PROBLEM  HAVE  BEEN  OBTAINED  IN  [l],  [12],  AND  [14].  IT  IS 
SHOWN  THAT  IN  GENERAL  THE  PROBLEM  IS  NP-HARD,  AND  THAT  IF  P 
<>  NP,  IT  IS  ALSO  NOT  FULLY  APPROXIMABLE.  TWO  HEURISTIC 
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ALGORITHMS  FOR  THE  PROBLEM  ARE  ALSO  GIVEN  AND  COMPARED. 
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ABSTRACT: 

THIS  PAPER  STUDIES  A PARTIAL-MATCH  RETRIEVAL  SCHEME  BASED  ON 
HASH  FUNCTIONS  AND  DESCRIPTORS.  THE  EMPHASIS  IS  PLACED  ON 
SHOWING  HOW  THE  USE  OF  A DESCRIPTOR  FILE  CAN  IMPROVE  THE 
PERFORMANCE  OF  THE  SCHEME.  RECORDS  IN  THE  FILE  ARE  GIVEN 
ADDRESSES  ACCORDING  TO  HASH  FUNCTIONS  FOR  EACH  FIELD  IN  THE 
RECORD.  FURTHERMORE,  EACH  PAGE  OF  THE  FILE  HAS  ASSOCIATED 
WITH  IT  A DESCRIPTOR,  WHICH  IS  A FIXED-LENGTH  BIT  STRING, 
DETERMINED  BY  THE  RECORDS  ACTUALLY  PRESENT  IN  THE  PAGE. 

BEFORE  A PAGE  IS  ACCESSED  TO  SEE  IF  IT  CONTAINS  RECORDS  IN 
THE  ANSWER  TO  A QUERY,  THE  DESCRIPTOR  FOR  THE  PAGE  IS 
CHECKED.  THIS  CHECK  MAY  SHOW  THAT  NO  RELEVANT  RECORDS  ARE  ON 
THE  PAGE  AND,  HENCE,  THAT  THE  PAGE  DOES  NOT  HAVE  TO  BE 
ACCESSED.  THE  METHOD  IS  SHOWN  TO  HAVE  A VERY  SUBSTANTIAL 
PERFORMANCE  ADVANTAGE  OVER  PURE  HASHING  SCHEMES,  WHEN  SOME 
FIELDS  IN  THE  RECORDS  HAVE  LARGE  KEY  SPACES.  A MATHEMATICAL 
MODEL  OF  THE  SCHEME,  PLUS  AN  ALGORITHM  FOR  OPTIMIZING 
PERFORMANCE,  IS  GIVEN. 
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ABSTRACT: 

IN  MOST  DATABASE  ORGANIZATIONS,  THE  COST  OF  ACCESSING  THE 
DATABASE  WILL  INCREASE  DUE  TO  STRUCTURAL  CHANGES  CAUSED  BY 
UPDATES  AND  INSERTIONS.  BY  REORGANIZING  THE  DATABASE,  THE 
ACCESS  COSTS  CAN  BE  REDUCED.  A BASIC  PROBLEM  IS  TO  ESTABLISH 
THE  PROPER  TRADEOFF  BETWEEN  PERFORMANCE,  STORAGE  COSTS,  AND 
REORGANIZATION  COSTS.  THIS  PAPER  CONSIDERS  THE  OPTIMUM 
POINTS  AT  WHICH  TO  REORGANIZE  A DATABASE.  A DISK  FILE 
ORGANIZATION  WHICH  ALLOWS  FOR  DISTRIBUTED  FREE  SPACE  IS 
DESCRIBED.  A COST  FUNCTION  DESCRIBING  THE  EXCESS  COSTS  DUE 
TO  PHYSICAL  DISORGANIZATION  IS  DEFINED,  AND  THIS  FUNCTION  IS 
MINIMIZED  TO  OBTAIN  THE  OPTIMUM  REORGANIZATION  POINTS. 
NUMERICAL  EXAMPLES  BASED  ON  THE  CHARACTERISTICS  OF  EXISTING 
DISK  STORAGE  DEVICES  ARE  GIVEN. 
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THE  VIRTUAL  MACHINE  EMULATOR  IS  AN  ENHANCED  VERSION  OF  IBM’S 
VM/370  PROGRAM  THAT  EXTENDS  THE  VIRTUAL  MACHINE  ENVIRONMENT 
TO  INCLUDE  TIMING  SIMULATION  IN  ADDITION  TO  THE  EXISTING 
SIMULATION  OF  MACHINE  FUNCTION.  BY  SELECTING  PROCESSOR  AND 
I/O  DEVICE  TIMING  CHARACTERISTICS,  THE  USER  CAN  EVALUATE  THE 
PERFORMANCE  OF  A WIDE  RANGE  OF  IBM  370  COMPATIBLE  SYSTEMS 
WITH  GREATER  FLEXIBILITY  AND  LOWER  COST  THAN  HARDWARE 
PROTOTYPING.  VALIDATION  DATA  ARE  PRESENTED  SHOWING  THAT  THE 
EMULATOR  IS  AN  ACCURATE  PERFORMANCE  PREDICTOR  WITH  A LOW 
SIMULATION  OVERHEAD. 
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AMONG  THE  MOST  IMPORTANT  CRITERIA  IN  THE  DESIGN  AND 
IMPLEMENTATION  OF  AN  INTERACTIVE  SYSTEM  FOR  DATA  ANALYSIS 
ARE:  DATA  STRUCTURE,  CONTROL  LANGUAGE,  USER  INTERFACE, 
SYSTEM  VERSATILITY,  EXTENSIBILITY,  AND  PORTABILITY.  THE 
DESIGN  OF  AN  INTERACTIVE  SYSTEM,  VIEWED  AS  A SET  OF 
CONSTRAINED  DECISIONS  BASED  ON  THESE  CRITERIA,  WILL  BE 
DISCUSSED.  THE  CONCEPTS  AND  CONSIDERATIONS  DISCUSSED  IN  THIS 
ARTICLE  ABOUT  THE  DESIGN  OF  INTERACTIVE  SYSTEMS  ARE  GENERAL 
IN  NATURE  AND  ARE  NEITHER  PROBLEM-SPECIFIC  NOR 
DISCIPLINE-SPECIFIC.  SPECIFIC  EXAMPLES  FROM  STATISTICAL 
PACKAGES  AND  THEIR  DESIGNS  ARE  CITED  FOR  ILLUSTRATION 
PURPOSES  ONLY. 
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STUDYING  PROGRAMMER  BEHAVIOR  EXPERIMENTALLY:  THE  PROBLEMS  OF 
PROPER  METHODOLOGY 

AUTHOR(s): 

BROOKS,  RUVEN  E. 

AFFILIATION: 

THE  UNIVERSITY  OF  TEXAS  MEDICAL  BRANCH,  GALVESTON,  TEXAS 
ABSTRACT: 

THE  APPLICATION  OF  BEHAVIORAL  OR  PSYCHOLOGICAL  TECHNIQUES  TO 
THE  EVALUATION  OF  PROGRAMMING  LANGUAGES  AND  TECHNIQUES  IS  AN 
APPROACH  WHICH  HAS  FOUND  INCREASED  APPLICABILITY  OVER  THE 
PAST  DECADE.  IN  ORDER  TO  USE  THIS  APPROACH  SUCCESSFULLY, 
INVESTIGATORS  MUST  PAY  CLOSE  ATTENTION  TO  METHODOLOGICAL 
ISSUES,  BOTH  IN  ORDER  TO  INSURE  THE  GENERALIZABILITY  OF 
THEIR  FINDINGS  AND  TO  DEFEND  THE  QUALITY  OF  THEIR  WORK  TO 
RESEARCHERS  IN  OTHER  FIELDS.  THREE  MAJOR  AREAS  OF 
METHODOLOGICAL  CONCERN,  THE  SELECTION  OF  SUBJECTS, 

MATERIALS,  AND  MEASURES,  ARE  REVIEWED.  THE  FIRST  TWO  OF 
THESE  AREAS  CONTINUE  TO  PRESENT  MAJOR  DIFFICULTIES  FOR  THIS 
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TYPE  OF  RESEARCH. 
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CACM 

VOLUME:  23 

ISSUE:  7 

DATE:  JULY  1980 
PAGES:  396  - 410 

TITLE: 

THE  KEYSTROKE-LEVEL  MODEL  FOR  USER  PERFORMANCE  TIME  WITH 
INTERACTIVE  SYSTEMS 

AUTHOR(s): 

CARD,  STUART  K.  » MORAN,  THOMAS  P. 

AFFILIATION: 

XEROX  PALO  ALTO  RESEARCH  CENTER  * XEROX  PALO  ALTO  RESEARCH 
CENTER  * CARNEGIE-MELLON  UNIVERSITY 

ABSTRACT: 

THERE  ARE  SEVERAL  ASPECTS  OF  USER-COMPUTER  PERFORMANCE  THAT 
SYSTEM  DESIGNERS  SHOULD  SYSTEMATICALLY  CONSIDER.  THIS 
ARTICLE  PROPOSES  A SIMPLE  MODEL,  THE  KEYSTROKE-LEVEL  MODEL, 

FOR  PREDICTING  ONE  ASPECT  OF  PERFORMANCE:  THE  TIME  IT  TAKES 
AN  EXPERT  USER  TO  PERFORM  A GIVEN  TASK  ON  A GIVEN  COMPUTER 
SYSTEM.  THE  MODEL  IS  BASED  ON  COUNTING  KEYSTROKES  AND  OTHER 
LOW-LEVEL  OPERATIONS,  INCLUDING  THE  USER’S  MENTAL 
PREPARATIONS  AND  THE  SYSTEM’S  RESPONSE.  PERFORMANCE  IS  CODED 
IN  TERMS  OF  THESE  OPERATIONS  AND  OPERATOR  TIMES  SUMMED  TO 
GIVE  PREDICTIONS.  HEURISTIC  RULES  ARE  GIVEN  FOR  PREDICTING 
WHERE  MENTAL  PREPARATIONS  OCCUR.  WHEN  TESTED  AGAINST  DATA  IN 
10  DIFFERENT  SYSTEMS,  THE  MODEL’S  PREDICTION  ERROR  IS  21 
PERCENT  FOR  INDIVIDUAL  TASKS.  AN  EXAMPLE  IS  GIVEN  TO 
ILLUSTRATE  HOW  THE  MODEL  CAN  BE  USED  TO  PRODUCE  PARAMETRIC 
PREDICTIONS  AND  HOW  SENSITIVITY  ANALYSIS  CAN  BE  USED  TO 
REDEEM  CONCLUSIONS  IN  THE  FACE  OF  UNCERTAIN  ASSUMPTIONS. 
FINALLY,  THE  MODEL  IS  COMPARED  TO  SEVERAL  SIMPLER  VERSIONS. 

THE  POTENTIAL  ROLE  FOR  THE  KEYSTROKE-LEVEL  MODEL  IN  SYSTEM 
DESIGN  IS  DISCUSSED. 

KEYWORDS: 

HUMAN-COMPUTER  INTERFACE  » HUMAN-COMPUTER  INTERACTION  * USER 
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TITLE: 

COMPUTER  SYSTEM  DESIGN  USING  A HIERARCHICAL  APPROACH  TO 
PERFORMANCE  EVALUATION 

AUTHOR(s): 

KUMAR,  B.  » DAVIDSON,  E.  S. 

AFFILIATION: 

ELXSI  INTERNATIONAL  » UNIVERSITY  OF  ILLINOIS 
ABSTRACT: 

THE  CONCEPT  OF  A HIERARCHY  OF  PERFORMANCE  MODELS  IS 
INTRODUCED.  IT  IS  ARGUED  THAT  SUCH  A HIERARCHY  SHOULD 
CONSIST  OF  MODELS  SPANNING  A WIDE  RANGE  OF  ACCURACY  AND  COST 
IN  ORDER  TO  BE  A COST-EFFECTIVE  TOOL  IN  THE  DESIGN  OF 
COMPUTER  SYSTEMS.  JUDICIOUS  USE  OF  THE  HIERARCHY  CAN  SATISFY 
THE  CONFLICTING  NEEDS  OF  HIGH  ACCURACY  AND  LOW  COST  OF 
PERFORMANCE  EVALUATION.  A SYSTEM  DESIGN  PROCEDURE  THAT  USES 
THE  HIERARCHY  IS  DEVELOPED.  THE  CONCEPTS  DEVELOPED  ARE 
ILLUSTRATED  BY  APPLYING  THEM  TO  A CASE  STUDY  OF  SYSTEM 
DESIGN.  THE  RESULTS  OF  OPTIMIZATIONS  CONDUCTED  USING  A 
TWO-LEVEL  PERFORMANCE  MODEL  HIERARCHY  AND  A SIMPLE  COST 
MODEL  ARE  DISCUSSED.  IN  ALMOST  ALL  THE  EXPERIMENTS 
CONDUCTED,  THE  OPTIMIZATION  PROCEDURE  CONVERGED  TO  A REGION 
VERY  CLOSE  TO  A LOCALLY  OPTIMUM  SYSTEM.  THE  EFFICIENCY  OF 
THE  PROCEDURE  IS  SHOWN  TO  BE  CONSIDERABLY  GREATER  THAN  THAT 
OF  THE  BRUTE  FORCE  APPROACH  TO  SYSTEM  DESIGN. 

KEYWORDS: 

HIERARCHICAL  MODELING  * PERFORMANCE  EVALUATION  * SYSTEM 
DESIGN  * OPTIMIZATION  ALGORITHMS  » HIGH  SPEED  COMPUTER 
SYSTEMS 

CATEGORIES: 
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TITLE: 

EVALUATION  OF  INFORMATION  RETRIEVAL  SYSTEMS:  A DECISION 
THEORY  APPROACH 

AUTHOR(s): 

KRAFT,  DONALD  H.  ♦ BOOKSTEIN,  ABRAHAM 
AFFILIATION: 

SCHOOL  OF  LIBRARIANSHIP,  UNIVERSITY  OF  CALIFORNIA,  BERKELEY 
♦ GRADUATE  LIBRARY  SCHOOL,  UNIVERSITY  OF  CHICAGO,  CHICAGO 

ABSTRACT: 

THE  SWETS  MODEL  OF  INFORMATION  RETRIEVAL,  BASED  ON  A 
DECISION  THEORY  APPROACH,  IS  DISCUSSED,  WITH  THE  OVERALL 
PERFORMANCE  MEASURE  BEING  THE  CRUCIAL  ELEMENT  REEXAMINED  IN 
THIS  PAPER.  THE  NEYMAN-PEARSON  CRITERION  FROM  STATISTICAL 
DECISION  THEORY,  AND  BASED  ON  LIKELIHOOD  RATIOS,  IS  USED  TO 
DETERMINE  AN  OPTIMAL  RANGE  OF  Z,  THE  VARIABLE  ASSIGNED  TO 
EACH  DOCUMENT  BY  THE  RETRIEVAL  SYSTEM  IN  AN  ATTEMPT  TO 
DISCRIMINATE  BETWEEN  RELEVANT  AND  NONRELEVANT  DOCUMENTS. 
THIS  CRITERION  IS  SHOWN  TO  BE  DIRECTLY  RELATED  TO  BOTH 
PRECISION  AND  RECALL,  AND  IS  EQUIVALENT  TO  THE  MAXIMIZATION 
OF  THE  EXPECTED  VALUE  OF  THE  RETRIEVAL  DECISION  FOR  A 
SPECIFIC  QUERY  AND  A GIVEN  DOCUMENT  UNDER  CERTAIN 
CONDITIONS.  THUS,  A COMPROMISE  CAN  BE  REACHED  BETWEEN  THOSE 
WHO  ADVOCATE  PRECISION  AS  A MEASURE,  DUE  PARTIALLY  TO  ITS 
ABILITY  TO  BE  EASILY  MEASURABLE  EMPIRICALLY,  AND  THOSE  WHO 
ADVOCATE  CONSIDERATION  OF  RECALL.  SEVERAL  CASES  OF  THE 
NORMAL  AND  POISSON  DISTRIBUTIONS  FOR  THE  VARIABLE  Z ARE 
DISCUSSED  IN  TERMS  OF  THEIR  IMPLICATIONS  FOR  THE 
NEYMAN-PEARSON  DECISION  RULE.  IT  IS  SEEN  THAT  WHEN  THE 
VARIANCES  ARE  UNEQUAL,  THE  SWETS  RULE  OF  RETRIEVING  A 
DOCUMENT  IF  ITS  Z VALUE  IS  LARGE  ENOUGH  IS  NOT  OPTIMAL. 
FINALLY,  THE  SITUATION  OF  PRECISION  AND  RECALL  NOT  BEING 
INVERSELY  RELATED  IS  SHOWN  TO  BE  POSSIBLE  UNDER  CERTAIN 
CONDITIONS.  THUS,  THIS  PAPER  ATTEMPTS  TO  EXTEND  THE 
UNDERSTANDING  OF  THE  THEORETICAL  FOUNDATIONS  OF  THE  DECISION 
THEORY  APPROACH  TO  INFORMATION  RETRIEVAL. 

KEYWORDS: 

INFORMATION  RETRIEVAL  * INFORMATION  THEORY  • QUERY  * 

VARIABLES 
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TITLE: 

THE  APPLICATION  OF  MULTIPLE-CRITERIA  UTILITY  THEORY  TO  THE 
EVALUATION  OF  INFORMATION  SYSTEMS 


AUTHOR(s): 

HERNER,  SAUL  * SNAPPER,  KURT  J. 

AFFILIATION: 

HERNER  AND  COMPANY,  WASHINGTON,  DC 
ABSTRACT: 

THE  USE  OF  MULTIPLE-CRITERIA  THEORY,  A MEANS  OF  MEASURING 
DEGREE  OF  SATISFACTION  OF  PREDETERMINED  EVALUATIVE  CRITERIA, 
QUANTIFYING  THEIR  RELATIVE  IMPORTANCE,  IDENTIFYING  TRADEOFFS 
AMONG  THEM,  AND  DETERMINING  THE  BEST  TRADEOFFS,  IS  PROPOSED 
FOR  THE  EVALUATION  OF  INFORMATION  SYSTEMS.  USE  OF  THE 
PROPOSED  METHOD  IS  DEMONSTRATED  VIA  THE  EVALUATION  OF  A 
HYPOTHETICAL  SELECTIVE  DISSEMINATION  OF  INFORMATION  (SDI) 
SYSTEM.  THE  ILLUSTRATIVE  EVALUATION  INVOLVES  (l)  SELECTION 
OF  TWO  SETS  OF  TYPICALLY  ANTITHETIC  CRITERIA:  EFFICIENCY 
(THE  INNER  WORKINGS  OF  THE  SYSTEM)  AND  EFFECTIVENESS  (ITS 
IMPACT  ON  ITS  USERS);  (2)  RANKING  AND  SCORING  EACH  CRITERION 
IN  THE  TWO  SETS;  (3)  SELECTION  OF  ALTERNATIVE  CONFIGURATIONS 
OF  THE  SYSTEM  UNDER  STUDY;  (4)  SCORING  THE  SPECIMEN  AND  THE 
ALTERNATIVE  SYSTEMS  IN  TERMS  OF  THE  RATED  EFFICIENCY  AND 
EFFECTIVENESS  CRITERIA;  AND  (5)  IDENTIFYING  THE  SYSTEM  THAT 
SCORES  THE  HIGHEST.  THE  COMPARATIVE  SCORES  FOR  THE  SYSTEMS 
ARE  DETERMINED  BY  Ui  = [(WO(Si’)  + (W”)(Si”)],  WHERE  Si’ 

AND  Si”  DENOTE  THE  EFFICIENCY  AND  EFFECTIVENESS  SCORES  OF 
THE  iTH  ALTERNATIVE,  AND  W’  AND  W”  ARE  WEIGHTING  CONSTANTS 
THAT  REFLECT  THE  COMPUTED  RELATIVE  IMPORTANCE  OF  EFFICIENCY 
AND  EFFECTIVENESS. 

KEYWORDS: 

UTILITY  THEORY  * SYSTEM  EVALUATION  * STATISTICAL  MEASUREMENT 
• INFORMATION  SYSTEM 
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CONTRIBUTION  TO  THE  ALLOCATION  PROBLEM 


AUTHOR(s): 

McCRATH,  WILLIAM  E. 

AFFILIATION: 

UNIVERSITY  OF  LOWELL 

ABSTRACT: 

IT  IS  SHOWN  THAT  DIFFERENT  SETS  OF  VARIABLES  CAN  ACCOUNT  FOR 
NEARLY  EQUAL  AMOUNTS  OF  VARIANCE  WHEN  PREDICTING  BOOK 
CIRCULATION  BY  SUBJECT.  PROPORTION  of  VARIANCE  (R**2)  FOR 
TWO  BASIC  MODELS  CONTAINING  VARIOUS  COMBINATIONS  OF  21 
VARIABLES  WERE  TESTED.  THE  FIRST,  CALLED  THE  SHELFLIST 
MODEL,  TREATED  THE  NUMBER  OF  LIBRARY  BOOKS,  WHOSE  SUBJECTS 
MATCH  THOSE  OF  ACADEMIC  DEPARTMENTS,  AS  A CONTROL  VARIABLE. 
AS  SUCH,  IT  ACCOUNTED  FOR  67%  OF  THE  VARIANCE,  THUS  ENTERING 
THE  EQUATION  FIRST.  WITH  THIS  MODEL,  FOUR  SEPARATE 
SIGNIFICANT  SETS  EMERGED,  EACH  ACCOUNTING  FOR  APPROXIMATELY 
THE  SAME  AMOUNT  OF  VARIANCE  (10%).  THEY  WERE  (l)  NUMBER  OF 
FACULTY,  HARD/SOFT,  MASTERS  ENROLLMENTS;  (2)  MASTERS 
ENROLLMENT,  UPPER-LEVEL  MAJORS,  HARD/SOFT;  (3)  CREDIT  HOURS 
* TOTAL  ENROLLMENTS,  HARD/SOFT;  (4)  UPPER-LEVEL  MAJORS, 

TOTAL  MAJORS,  ENROLLMENTS  LOWER.  IN  THE  SECOND,  SHELFLIST 
WAS  CONSTRAINED  BY  DEFINING  THE  DEPENDENT  VARIABLE  AS  THE 
PROPORTION  OF  SHELFLIST  CIRCULATED.  WITH  THIS  MODEL,  THREE 
SEPARATE  SIGNIFICANT  SETS  EMERGED.  THESE  WERE  (5)  MASTERS 
ENROLLMENTS  AND  HARD/SOFT  (20%)  VARIANCE;  (6)  HARD-SOFT  AND 
PH.  D.  PROGRAM  (l6?o);  (7)  UPPER-LEVEL  MAJORS,  AND  CREDIT 
HOURS  * TOTAL  MAJORS  (15%).  IN  EACH  OF  THE  TESTS,  NO  OTHER 
VARIABLES  WERE  SIGNIFICANT.  OF  THE  21  VARIABLES,  10  DID  NOT 
APPEAR  IN  ANY  OF  THE  7 SETS.  ANY  OF  THE  SEVEN  SETS  COULD  BE 
USED  IN  AN  ALLOCATION  FORMULA.  THE  DECIDING  CRITERION  FOR 
CHOOSING  A SET  MAY  DEPEND  ON  THE  CONVENIENCE  OF  COLLECTING 
DATA  FOR  EACH  OF  THE  VARIABLES  IN  THE  SET. 

KEYWORDS: 

MODELS  » EDUCATION  * SETS  » VARIABLES 
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AFFILIATION: 

MEDICAL  INFORMATION  SCIENCE,  UNIVERSITY  OF  CALIFORNIA  AT  SAN 
FRANCISCO 

ABSTRACT: 

THERE  IS  A GREAT  NEED  FOR  A SYSTEMATIC  APPROACH  TO  THE 
SPECIFICATION,  DESIGN,  AND  DEVELOPMENT ' OF  INFORMATION 
SYSTEMS.  THIS  ARTICLE  DESCRIBES  THE  MOTIVATING  REASONS  FOR 
SUCH  AN  APPROACH  AND  SURVEYS  SOME  OF  THE  TECHNIQUES  THAT 
HAVE  BEEN  DEVELOPED  TO  ASSIST  THE  SOFTWARE  SPECIFICATION  AND 
DESIGN  ACTIVITY.  A METHODOLOGY  IS  SEEN  AS  A COMBINATION  OF 
TOOLS  AND  TECHNIQUES  EMPLOYED  WITHIN  AN  ORGANIZATIONAL  AND 
MANAGERIAL  FRAMEWORK  THAT  CAN  BE  CONSISTENTLY  APPLIED  TO 
SUCCESSIVE  INFORMATION  SYSTEM  DEVELOPMENT  PROJECTS.  THE  WAYS 
THAT  INFORMATION  SYSTEM  DEVELOPMENT  ORGANIZATIONS  CAN  CREATE 
AND  USE  SUCH  METHODOLOGIES  ARE  EMPHASIZED. 

KEYWORDS: 

DESIGN  METHODOLOGY  » INFORMATION  SYSTEM  » SOFTWARE 
SPECIFICATION 
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BROOKES,  BERTRAM  C. 

AFFILIATION; 

SCHOOL  OF  LIBRARY  AND  INFORMATION  SCIENCE,  UNIVERSITY  OF 
WESTERN  ONTARIO 

ABSTRACT: 

IT  IS  ARGUED  THAT  IN  INFORMATION  SCIENCE  WE  HAVE  TO 
DISTINGUISH  PHYSICAL,  OBJECTIVE,  OR  DOCUMENT  SPACE  FROM 
PERSPECTIVE,  SUBJECTIVE,  OR  INFORMATION  SPACE.  THESE  TWO 
SPACES  ARE  LIKE  MAPS  AND  LANDSCAPES:  EACH  IS  A SYSTEMATIC 
DISTORTION  OF  THE  OTHER.  HOWEVER,  TRANSFORMATIONS  CAN  BE 
EASILY  MADE  ONCE  THE  TWO  SPACES  ARE  DISTINGUISHED.  IF  THE 
TRANSFORMATIONS  ARE  OMITTED  WE  ONLY  GET  UNHELPFUL  PHYSICAL 
SOLUTIONS  TO  INFORMATION  PROBLEMS. 

KEYWORDS: 

INFORMATION  SCIENCE  * METRICAL  SPACE  * TRANSFORMATION 
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A MANAGEMENT-ORIENTED  MODEL  FOR  DESCRIBING  AND  STUDYING 


- 73  - 


INFORMATION  BEHAVIOR  IS  PROPOSED.  THE  MODEL  FOCUSES  ON 

VARIABLES  WHICH  CAN  BE  MANIPULATED  BY  MANAGERS PRIMARILY 

ENVIRONMENTAL  AND  SITUATIONAL  VARIABLES RATHER  THAN  ON 

VARIABLES  DESCRIBING  INDIVIDUAL  ATTRIBUTES.  SEVERAL 
HYPOTHESES  DERIVED  FROM  THE  MODEL  ARE  TESTED  USING  A 
DATABASE  DESCRIBING  THE  INFORMATION-RELATED  ATTITUDES  AND 
BEHAVIORS  OF  SOME  560  SCIENTISTS  AND  ENGINEERS  WORKING  IN  A 
VARIETY  OF  SETTINGS  AND  ROLES.  ALL  BUT  ONE  OF  THE  HYPOTHESES 
WERE  CONFIRMED,  ADDING  SUPPORT  TO  THE  MODEL.  THE  RESULTS  OF 
THESE  TESTS  SUGGEST  THAT  ENVIRONMENTAL  AND  SITUATIONAL 
CONSTRAINTS  PLAY  A MAJOR  PART  IN  DETERMINING  INFORMATION 
BEHAVIOR.  THEY  SUGGEST  THAT  INTERVENTIONS  AIMED  AT  IMPROVING 
INFORMATION  FLOW  WITHIN  ORGANIZATIONS  MUST  BE  CAREFULLY 
TAILORED  TO  THE  SPECIFIC  SITUATION  IF  THEY  ARE  TO  HAVE 
MAXIMUM  IMPACT. 

KEYWORDS: 

MANAGEMENT  MODEL  * INFORMATION  BEHAVIOR  * HYPOTHESES  * DATA 
BASE  » ENVIRONMENT  * SITUATIONAL 
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ABSTRACT: 

THE  PRIMARY  GOAL  OF  THIS  RESEARCH  WAS  TO  DISCOVER  THOSE 
BEHAVIORS  ASSOCIATED  WITH  THE  PROCESS  OF  ONLINE 
BIBLIOGRAPHIC  SEARCHING  THAT  ARE  CORRELATED  WITH  SUCCESS.  IN 
THE  ASSUMPTION  THAT  MORE  EXPERIENCED  SEARCHERS  ARE  MORE 
SUCCESSFUL,  THE  RESEARCH  OBJECTIVES  WERE  TO  IDENTIFY  (l)  THE 
DIFFERENCES  AMONG  THE  SEARCHES  OF  USERS  OF  ONLINE  SYSTEMS 
WHO  HAVE  DIFFERENT  AMOUNTS  OF  OVERALL  EXPERIENCE  AND  (2)  THE 
DIFFERENCES  BETWEEN  THE  SEARCHES  OF  PERSONS  WITH  AND  WITHOUT 
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EXPERIENCE  ON  THE  DATABASE  BEING  SEARCHED.  FIVE  GROUPS  OF 
SEARCHERS  WITH  VARIED  OVERALL  AND  ERIC  ( EDUCATIONAL 
RESOURCES  INFORMATION  CENTER)  DATABASE  EXPERIENCE  PERFORMED 
PRESELECTED  SEARCHES  ON  THE  DIALOG  SYSTEM  USING  ONTAP,  THE 
1975  SUBSET  OF  THE  ERIC  DATABASE.  ANALYSIS  OF  THE  SEARCH 
TRANSCRIPTS  SHOWED  THAT  DIFFERENCES  AMONG  THE  GROUPS  WERE 
NOT  LARGE.  COMPARED  TO  THE  EXPERIENCED  SUBJECTS,  BEGINNING 
SEARCHERS  PERFORMED  SURPRISINGLY  WELL.  THE  GROUP  WITH  THE 
GREATEST  OVERALL  EXPERIENCE  AND  THE  GREATEST  ERIC  DATABASE 
EXPERIENCE  ACHIEVED  THE  HIGHEST  RECALL  AND  HAD  THE  HIGHEST 
VALUES  OF  A SET  OF  SEARCH  PROCESS  VARIABLES  DESIGNATED 
"SEARCH  EFFORT”  VARIABLES  (EG.,  NUMBER  OF  COMMANDS  AND 
DESCRIPTORS,  CONNECT  TIME)  SUGGESTING  A POSSIBLE 
RELATIONSHIP  BETWEEN  SEARCH  EFFORT  AND  RECALL. 

KEYWORDS: 
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THE  RELATIONAL  MODEL  IN  INFORMATION  RETRIEVAL 
AUTHOR(s): 

CRAWFORD.  ROBERT  G. 

AFFILIATION: 

DEPARTMENT  OF  COMPUTING  AND  INFORMATION  SCIENCE,  QUEEN’S 
UNIVERSITY, 

ABSTRACT: 

THE  RELATIONAL  MODEL  HAS  RECEIVED  INCREASING  ATTENTION 
DURING  THE  PAST  DECADE.  ITS  ADVANTAGES  INCLUDE  SIMPLICITY, 
CONSISTENCY,  AND  A SOUND  THEORETICAL  BASIS.  IN  THIS  ARTICLE, 

THE  NATURALNESS  OF  VIEWING  INFORMATION  RETRIEVAL 
RELATIONALLY  IS  DEMONSTRATED.  THE  RELATIONAL  MODEL  IS 
PRESENTED,  AND  THE  RELATIONAL  ORGANIZATION  OF  A 
BIBLIOGRAPHICAL  DATABASE  IS  SHOWN.  THE  NOTION  OF 
NORMALIZATION  IS  INTRODUCED  AND  FIRST,  SECOND,  THIRD,  AND 
FOURTH  NORMAL  FORMS  ARE  DEMONSTRATED.  RELATIONAL  LANGUAGES 
ARE  DISCUSSED,  INCLUDING  THE  RELATIONAL  CALCULUS,  RELATIONAL 
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ALGEBRA,  AND  SEQUEL.  NUMEROUS  EXAMPLES  PERTINENT  TO 
INFORMATION  RETRIEVAL  ARE  PRESENTED  IN  THESE  RELATIONAL 
LANGUAGES.  ADVANTAGES  OF  THE  RELATIONAL  APPROACH  TO 
INFORMATION  RETRIEVAL  .ARE  NOTED. 

KEYWORDS: 
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ABSTRACT: 

STATISTICAL  ANALYSES  OF  ONLINE  SEARCHING  PATTERNS  COMPARED 
THE  USAGE  OF  A QUERY  LANGUAGE  BY  VARIOUS  GROUPS  OF 
SEARCHERS.  DATA  WERE  GATHERED  BY  AN  EXPERIMENTAL  PROJECT, 
INDIVIDUALIZED  INSTRUCTION  FOR  DATA  ACCESS  (IIDA),  CONCERNED 
WITH  DEVELOPING  AND  TESTING  A SYSTEM  WHICH  SERVES  AS  A 
TEACHER  AND  ASSISTANT  TO  USERS  OF  LOCKHEED’S  DIALOG  SYSTEM. 
SEQUENTIAL  LISTINGS  OF  USER  COMMANDS  WERE  CLASSIFIED  BY 
CORRESPONDING  STATE  CODES  TO  REPRESENT  PHASES  OF  SEARCHING. 
ZERO-THROUGH  FOURTH-ORDER  MARKOVIAN  ANALYSES  OF  INDIVIDUAL 
COMMANDS  AND  STRINGS  OF  LIKE  COMMANDS  WERE  PERFORMED  TO 
COMPARE  SEARCHING  PROCEDURES  USED  BY  THREE  CLASSES  OF  USERS. 
CLASS  1 COMPARED  NOVICES  DIFFERING  IN  THEIR  USE  OF  IIDA  AS 
AN  ADJUNCT  TRAINER;  CLASS  2 COMPARED  INEXPERIENCED, 
IIDA-TRAINED  SEARCHERS  WITH  PROFESSIONAL  SEARCHERS;  CLASS  3 
COMPARED  INEXPERIENCED  SEARCHERS  TAUGHT  BY  EITHER  IIDA  OR 
PROFESSIONAL  SEARCHERS.  ANALYSIS  REVEALED  THAT  SEARCHERS 
TEND  TO  FOLLOW  THE  ADVICE  OF  THEIR  TRAINER,  WHETHER  IT  BE 
HUMAN  OR  COMPUTER.  THE  USE  OF  IIDA  AS  THE  SOLE  TRAINING 
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METHOD  APPEARS  TO  PRODUCE  SEARCHERS  WHO  USE  SIMILAR  PATTERNS 
OF  SEARCHING.  THE  USE  OF  ANOTHER  TRAINING  METHOD  IN  ADDITION 
TO  OR  INSTEAD  OF  IIDA  APPEARS  TO  PRODUCE  SEARCHERS  WITH 
VARIED  AND  INDIVIDUAL  ’’STYLES”  OF  ONLINE  SEARCHING. 

KEYWORDS: 
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AFFILIATION: 

DREXEL  UNIVERSITY,  PHILADELPHIA 
ABSTRACT: 

THIS  IT  THE  FIRST  OF  TWO  ARTICLES  THAT  REPORT  ON  THE 
DEVELOPMENT,  TESTING,  AND  EVALUATION  OF  THE  INDIVIDUALIZED 
INSTRUCTION  FOR  DATA  ACCESS  SYSTEM  (IIDA).  IIDA  IS  AN 
EXAMPLE  OF  A CLASS  OF  COMPUTER  SYSTEMS  WHICH  SERVE  AS 
INTERMEDIARIES,  ENABLING  THEIR  USERS  TO  PERFORM  A COMPLEX 
TASK  ON  ANOTHER  COMPUTER,  AND  WHICH  ARE  COMING  TO  BE  KNOWN 
AS  EXPERT  SYSTEMS.  THE  SYSTEM  WAS  DESIGNED  TO  ENCOURAGE  END 
USERS  OF  INFORMATION  RETRIEVAL  SYSTEMS  TO  PERFORM  THEIR  OWN 
SEARCHES  BY  (l)  INSTRUCTING  THEM  IN  HOW  TO  SEARCH,  USING 
COMPUTER-ASSISTED  INSTRUCTION,  AND  (2)  ASSISTING  WITH  THE 
PERFORMANCE  OF  THE  SEARCH  BY  PROVIDING  DIAGNOSTIC  ANALYSES 
OF  THE  USER’S  PERFORMANCE  AS  WELL  AS  ANSWERING  THEIR 
QUESTIONS  ABOUT  HOW  TO  USE  SYSTEM  COMMANDS.  THE  SYSTEM’S 
DESIGN  IS  DESCRIBED,  AS  WELL  AS  THE  VARIOUS  TESTS  OF  ITS 
PERFORMANCE  AND  THE  EVALUATION  OF  TEST  RESULTS.  THE 
CONCLUSION  IS  DRAWN  THAT  END  USERS  CAN  BECOME  SUCCESSFUL 
SEARCHERS  THROUGH  SUCH  AN  ASSISTANT,  FOR  THE  KINDS  OF 
SEARCHES  TESTED. 
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AFFILIATION: 

DREXEL  UNIVERSITY,  PHILADELPHIA 
ABSTRACT: 

THIS  IS  THE  SECOND  OF  TWO  ARTICLES  DESCRIBING  THE 
DEVELOPMENT,  TESTING,  AND  EVALUATION  OF  THE  INDIVIDUALIZED 
INSTRUCTION  FOR  DATA  BASE  ACCESS  SYSTEM  (IIDA).  THE  SYSTEM 
WAS  TESTED  IN  AN  INDUSTRIAL  SETTING  AND  IT  WAS  DEMONSTRATED 
THAT  (1)  END  USERS  OF  SCIENTIFIC  AND  TECHNICAL  LITERATURE 
COULD  LEARN  TO  DO  THEIR  OWN  BIBLIOGRAPHIC  SEARCHES  THROUGH 
COMPUTER-ASSISTED  INSTRUCTION  AS  WELL  AS  THEY  LEARNED 
THROUGH  A COMPARABLE  PERIOD  OF  CONVENTIONAL  INSTRUCTION,  AND 
(2)  END  USERS  WERE  AS  SATISFIED  WITH  THE  RESULTS  OF  THEIR 
OWN  SEARCHINGS  AS  WITH  THE  RESULT  OF  SEARCHES  PERFORMED  FOR 
THEM,  FOR  THE  TYPES  OF  SEARCHES  TESTED. 
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ABSTRACT: 

THE  FOCUS  OF  INFORMATION  RESEARCH  IN  ANY  GIVEN  DISCIPLINE 
DEPENDS  ON  THE  MEANING  OF  THE  WORD  "INFORMATION”  FOR 
SCIENTISTS  IN  THAT  DISCIPLINE.  THIS  ARTICLE  LISTS  SOME  OF 
THE  "DISCIPLINES  OF  INFORMATION”,  INCLUDING  Sr;VERAL  WITH  A 
STRONG  SYSTEMS  ORIENTATION,  AND  IDENTIFIES  1 iOSE  INFORMATION 
SCIENTISTS  FOR  WHOM  A KNOWLEDGE  OF  SYSIEM  METUODOI.OGY  IS 
IMPORTANT.  THIS  IS  FOLLOWED  BY  A BROADBRUSH  TREATMENT  OF  THE 
MODERN  SYSTEMS  MOVEMENT:  ITS  ROLE  IN  THE  CHANGING  WORLDVIEW 
OF  SCIENCE,  SOME  DISCIPLINES  (EG.,  CYBERNETICS  AND 
OPERATIONS  RESEARCH)  THAT  HAVE  CONTRIBUTED  TO  ITS 
DEVELOPMENT,'  AND  THE  DISTINCTION  THAT  CAN  BE  DRAWN  BETWEEN 
GENERAL  SYSTEMS  THEORY  (GST)  AND  OTHER  APPROACHES  TO  THE 

STUDY  OF  SYSTEMS A THEME  DEVELOPED  BY  MATTESSICH  IN  THE 

ARTICLE  THAT  FOLLOWS. 

KEYWORDS: 

SYSTEM  MOVEMENT  * INFORMATION  SCIENCE  * SYSTEM  METHODOLOGY  * 
SYSTEM  THEORY  * SYSTEM  ORIENTATION 

CATEGORIES: 

5.6 


REFERENCE  CODE:  117 

JOURNAL: 

JASIS 

VOLUME:  34 

ISSUE:  1 

DATE:  JANUARY  1983 
PAGES:  31  - 39 

TITLE: 

EXPLOITING  THE  MAXIMUM  ENTROPY  PRINCIPLE  TO  INCREASE 
RETRIEVAL  EFFECTIVENESS 


- 79  - 


AUTHOR(s): 

COOPER,  WILLIAM  S. 

AFFILIATION: 

SCHOOL  OF  LIBRARY  AND  INFORMATION  STUDIES,  UNIVERSITY  OF 
CALIFORNIA,  BERKELEY 

ABSTRACT: 

SEVERAL  OF  THE  DRAWBACKS  OF  CONVENTIONAL  INFORMATION 
RETRIEVAL  SYSTEMS  CAN  BE  OVERCOME  BY  A DESIGN  APPROACH  IN 
WHICH  QUERIES  CONSIST  OF  SETS  OF  TERMS,  EITHER  UNWEIGHTED  OR 
WEIGHTED  WITH  SUBJECTIVE  TERM  PRECISION  ESTIMATES,  AND 
RETRIEVAL  OUTPUTS  ARE  RANKED  BY  PROBABILITY  OF  USEFULNESS 
ESTIMATED  IN  ACCORDANCE  WITH  THE  SO-CALLED  ’’MAXIMUM  ENTROPY 
PRINCIPLE”.  A SYSTEM  ORGANIZED  ALONG  THESE  LINES  COMBINES 
THE  CONVENIENCE  OF  A SIMPLE  INPUT  LANGUAGE  WITH  A POWERFUL 
PROBABILISTIC  INFERENCE  MECHANISM  CAPABLE  OF  EXPLOITING 
KINDS  OF  STATISTICAL  CLUES  NOT  ORDINARILY  USED  IN  SYSTEMS  OF 
TRADITIONAL  DESIGN.  THE  SENSITIVITY  OF  THE  MAXIMUM  EN'l'ROPY 
PRINCIPLE  TO  THE  FREQUENCIES  AND  JOINT  FREQUENCIES  WITH 
WHICH  TERMS  HAVE  BEEN  ASSIGNED  TO  D0CUME:NTS  IN  THE 
COLLECTION  RESULTS  IN  A SYSTEM  DESIGN  OF  INCREASED  POWER  AND 
EXPRESSIVENESS  WITHOUT  A CONCOMITANT  INCREASE  IN  THE 
COMPLEXITY  OF  THE  REQUEST  LANGUAGE.  IT  INCORPORATES  THE  MORE 
IMPORTANT  SEARCH  CAPABILITIES  OF  BOTH  BOOLEAN  AND 
CONVENTIONAL  WEIGHTED-REQUEST  LANGUAGES  AND  FACILITATES  THE 
USE  OF  UNCONVENTIONAL  SEARCH  CLUES. 
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ABSTRACT: 

THIS  ARTICLE  DISCUSSES  WAYS  TO  IMPROVE  THE  QUALITY  OF 
retrieval  systems  THAT  DEPEND  ON  THE  USE  OF  TRUNCATED  WORDS 
OR  QUASI-WORD  STEMS  AS  AN  INDEXING  VOCABULARY.  THE  PROBLEMS 
ADDRESSED  ARE  THE  GENERALIZABILITY  AND  STABILITY  OF 
DISCRIMINATE  FUNCTION  ANALYSIS  FOR  SELECTING  GOOD  TOPICAL 
TERMS  FROM  ABSTRACTS  OF  HARRIS  SURVEY  PRESS  RELEASES. 

RESULTS  CONFIRM  THAT  TOPICAL  TERMS  CAN  BE  IDENTIFIED  BY 
THEIR  STATISTICAL  PROPERTIES.  CONSISTENTLY  HIGH  RECALL  OF 
TOPICAL  TERMS  UNDER  A VARIETY  OF  DIFFERENT  CONDITIONS 
IMPLIES  PERSISTENT  UNDERLYING  PROPERTIES  STRONG  ENOUGH  TO 
RESIST  CHANGES  IN  TEST  ENVIRONMENT. 
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ABSTRACT: 

THE  RELATIVE  EFFECTIVENESS  OF  INDEXING  USING  FULL-TEXT  OR 
LESS  THAN  FULL-TEXT  WAS  TESTED  USING  A NON-BOOLEAN,  CHAINING 
TYPE  OF  FILE  STRUCTURE  AND  SEARCHING  METHOD.  INDEXING  WAS 
DONE  USING  TITLES,  ABSTRACTS,  FULL-TEXT,  REFERENCES,  AND 
VARIOUS  COMBINATIONS  OF  THESE  SURROGATES  AND  THEN  GOFFMAN’S 
INDIRECT  METHOD  OF  INFORMATION  RETRIEVAL  WAS  USED  TO 
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STRUCTURE  AND  SEARCH  THE  FILE.  THE  DATABASE  CONSISTED  OF  733 
DOCUMENTS  AND  38  QUERIES  WERE  SEARCHED.  THE  HYPOTHESIS  OF 
THE  STUDY  AS  A FILE  STRUCTURING  AND  SEARCHING  TECHNIQUE, 
FULL-TEXT  INDEXING  IS  NOT  ESSENTIAL  TO  OPTIMUM  INFORMATION 
RETRIEVAL  EFFECTIVENESS.  THE  OUTCOME  OF  THE  STUDY  WAS 
POSITIVE. 
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ABSTRACT: 

THERE  HAS  BEEN  INCREASED  AWARENESS  IN  RECENT  YEARS  OF  THE 
HIGH  COST  OF  NON-HARDWARE  ITEMS  IN  THE  FEDERAL  ADP  BUDGET  IN 
CONTRAST  WITH  DECREASING  COSTS  FOR  MUCH  OF  THE  HARDWARE. 

MORE  ATTENTION  IS  BEING  GIVEN  TO  SOFTWARE  DEVELOPMENT  COSTS, 
SYSTEMS  DESIGN  PRACTICES,  AUTOMATIC  PROGRAM  TESTING,  AND  THE 
LIKE.  PARTICULAR  COMMERCIAL  AND  MILITARY  SYSTEMS 
EFFECTIVENESS  AND  LIFE  CYCLE  COSTS  NOW  TAKE  INTO 
CONSIDERATION  SUCH  FACTORS  AS  PART  OF  THE  PLANNING  PROCESS. 

IT  IS  SUGGESTED  THAT  NOT  ENOUGH  ATTENTION  HAS  BEEN  GIVEI^  TO 
MEASUREMENT  OF  HUMAN  PERFORMANCE  VARIABLES  AS  PART  OF  THE 
SYSTEMS  PROCUREMENT  AND  SYSTEMS  EVALUATION  PHASES  OF  FEDERAL 
ADP  PROGRAMS.  RECOMMENDATIONS  ARE  MADE  FOR  THE  INCORPORATION 
OF  SUCH  MEASURES  ALONG  WITH  CONVENTIONAL  HARDWARE/SOFTWARE 
PERFORMANCE  MEASUREMENT. 
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AFFILIATION: 
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ABSTRACT: 

THE  CONCEPT  OF  "WORKING-SET”  OF  A PROGRAM  RUNNING  IN  A 
VIRTUAL  MEMORY  ENVIRONMENT  IS  NOW  SO  FAMILIAR  THAT  MANY  OF 
US  FAIL  TO  REALIZE  JUST  HOW  LITTLE  WE  REALLY  KNOW  ABOUT  WHAT 
IT  IS,  WHAT  IT  MEANS,  AND  WHAT  CAN  BE  DONE  TO  MAKE  SUCH 
KNOWLEDGE  ACTUALLY  USEFUL.  THIS  FOLLOWS,  PERHAPS,  FROM  THE 
ABSTRACT  AND  APPARENTLY  INTANGIBLE  FACADE  THAT  TENDS  TO 
OBSCURE  THE  MEANING  OF  WORKING  SET.  WHAT  WE  CANNOT  MEASURE 
OFTEN  RANKS  HIGH  IN  CURIOSITY  VALUE,  BUT  RANKS  LOW  IN 
PRAGMATIC  UTILITY.  WHERE  WE  HAVE  MEASURES,  AS  IN  THE 
PAGE-SECONDS  OF  SMF/MVS,  THE  SITUATION  BECOMES  EVEN  MORE 
CURIOUS:  HERE  A SINGLE  NUMBER  PURPORTS  TO  TELL  US  CONCURRENT 
PROGRAMS,  AND  MAYBE  SOMETHING  ABOUT  THE  WORKING  SETS  OF 
OTHER  CONCURRENT  PROGRAMS,  BUT  NOT  VERY  MUCH  ABOUT  EITHER. 
THIS  PAPER  DESCRIBES  A CASE  IN  WHICH  THE  CONCEPT  OF  THE 
ELUSIVE  WORKING  SET  HAS  BEEN  ENCOUNTERED  IN  PRACTICE,  HAS 
BEEN  INTENSIVELY  ANALYZED,  AND  FINALLY,  HAS  BEEN  CONFRONTED 
IN  ITS  OWN  REALM.  IT  HAS  BEEN  TRAPPED,  WRAPPED,  AND,  AT 
LAST,  FORCED  TO  REVEAL  ITSELF  FOR  WHAT  IT  REALLY  IS.  IT  IS 
NOT  A NUMBER!  YET  IT  CAN  BE  MEASURED.  AND  WHAT  IT  IS, 

TOGETHER  WITH  ITS  MEASURES,  TURNS  OUT  TO  BE  SOMETHING  NOT 
ONLY  HIGH  IN  CURIOSITY  VALUE,  BUT  ALSO  SOMETHING  VERY  USEFUL 
AS  A MEANS  TO  PREDICT  THE  PAGE  FAULTING  BEHAVIOR  OF  A 
PROGRAM  RUNNING  IN  A RELATIVELY  COMPLEX  MULTI-  PROGRAMMED 
ENVIRONMENT.  THE  INFORMATION  PRESENTED  HERE  RELATES  TO 
EXPERIENCE  GAINED  DURING  THE  CONVERSION  OF  A DISCRETE  EVENT 
SIMULATION  MODEL  TO  A HYBRID  MODEL  WHICH  EMPLOYS  ANALYTICAL 
TECHNIQUES  TO  FORECAST  THE  DURATION  OF  "STEADY-  STATE” 
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INTERVALS  BETWEEN  MIX-CHANGE  EVENTS  IN  THE  SIMULATION  OF  A 
NETWORK-  SCHEDULED  JOB  STREAM  PROCESSING  ON  A 370/168-3AP 
UNDER  MVS.  THE  SPECIFIC  ’’ENCOUNTER”  WITH  THE  CONCEPT  OF 
WORKING  SETS  CAME  ABOUT  WHEN  AN  ANALYTICAL  TREATMENT  OF 
PROGRAM  PAGING  WAS  INCORPORATED  INTO  THE  MODEL.  AS  A RESULT 
OF  CONSIDERABLE  LUCK,  INGENUITY,  AND  BRUTE-FORCE  EMPIRICISM, 

THE  MODEL  WON.  SEVERAL  EXAMPLES  OF  EMPIRICALLY  DERIVED 
CHARACTERISTIC  WORKING  SET  FUNCTIONS,  TOGETHER  WITH  TYPICAL 
MODEL  RESULTS,  ARE  SUPPORTED  WITH  A DISCUSSION  OF  RELEVANT 
MODELING  TECHNIQUES  AND  AREAS  OF  APPLICATION. 
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THIS  PAPER  PRESENTS  THE  DEVELOPMENT  AND  EVALUATION  OF  A 
QUESTIONNAIRE  DESIGNED  TO  QUANTITATIVELY  MEASURE  COMPUTER 
USER  SATISFACTION.  THE  ADMINISTRATION,  SCORING,  AND 
INTERPRETATION  OF  THE  QUESTIONNAIRE  ARE  ALSO  ADDRESSED. 
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ABSTRACT: 

A NUMBER  OF  TOOLS  EX-IST  FOR  COMPUTER  SELECTION  EVALUATION. 

THE  OPERATIONAL  COST  OF  APPLYING  THESE  VARY  CONSIDERABLY  AS 
DOES  THE  PRECISION  OF  THE  PERFORMANCE  PREDICTION.  THIS  PAPER 
COMPARES  THE  PRECISION  OF  SEVERAL  COMMONLY  USED  METHODS  IN  A 
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ABSTRACT: 

A CASE  STUDY  OF  SHORT-RANGE  ADP  CAPACITY  PLANNING  IS 
PRESENTED  aND  RELATED  TO  THE  PROCESS  OF  LONG-RANGE  PLANNING. 
SHORT-RANGE  CAPACITY  PLANNING  IS  CONCERNED  WITH 
IDENTIFICATION  OF  COMPUTER  AND  COMMUNICATION  RESOURCES  WHICH 
WILL  REACH  SATURATION  LEVELS  IN  THE  NEAR  FUTURE.  THE  INITIAL 
STEP  IN  THE  SHORT-RANGE  PLANNING  PROCESS  IS  TO  EVALUATE  THE 
PERFORMANCE  OF  THE  USER’S  CURRENT  SYSTEM  CONFIGURATION  AND 
ONE  OR  MORE  CONFIGURATION  ENHANCEMENTS  WITH  RESPECT  TO  THEIR 
EFFECTIVENESS  IN  SUPPORTING  A PROJECTED  WORKLOAD.  CENTRAL  TO 
LONG-RANGE  PLANNING  IS  THE  EVALUATION  OF  A BROADER  RANGE  OF 
ARCHITECTURAL  ALTERNATIVES,  INCLUDING  VARIOUS  DISTRIBUTED 
PROCESSING  DESIGNS.  IN  BOTH  SHORT  RANGE  AND  LONG  RANGE 
PLANNING,  SYSTEM  MODELING  IS  A BASIC  TOOL  FOR  EVALUATING 
ALTERNATIVES.  AN  ANALYTIC  NETWORK  OF  QUEUES  MODEL  HAS  BEEN 
DEVELOPED  TO  REFLECT  BOTH  CENTRALIZED  AND  HIERARCHICALLY 
DISTRIBUTED  NETWORK  ARCHITECTURES.  THE  APPLICATION  OF  THE 
TOOL  AS  PART  OF  THE  SHORT-RANGE  CASE  STUDY  IS  DESCRIBED. 
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BUT  MOST  OF  THESE  HAVE  ASSOCIATED  IMPLEMENTATION  PROBLEMS  IN 
PRACTICE.  BY  ADOPTING  A SLIGHTLY  DIFFERENT  APPROACH,  (USING 
AN  APPROXIMATION  TO  "SERVICE  WAIT  TIME”),  AN  ANALYSIS  OF 
RESPONSE  IS  POSSIBLE  IN  A PRODUCTION  SYSTEM,  WITH  NEGLIGIBLE 
OVERHEAD.  THIS  ANALYSIS  ALLOWS  THE  ACTUAL  AREAS  OF 
CONTENTION  TO  BE  IDENTIFIED,  AND  SOME  RATHER  UNEXPECTED 
RESULTS  EMERGE,  WITH  A DIRECT  APPLICATION  TO  SCHEDULING 
POLICY.  THE  WORK  WAS  DONE  USING  THE  NOS/BE  OPERATING  SYSTEM 
ON  A CDC  CYBER  173  AT  THE  UNIVERSITY  OF  ADELAIDE. 
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ABSTRACT: 

A METHOD  SUGGESTING  HOW  TO  ORGANIZE  AND  OPERATE  A COMPUTER 
PERFORMANCE  AND  EVALUATION  (CPE)  PROJECT  IS  PRESENTED.  IT 
SHOULD  BE  NOTED  THAT  THE  SUGGESTED  PRINCIPLES  COULD  APPLY  TO 
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ABSTRACT: 

THE  THEORETICAL  ASPECTS  OF  OPERATIONAL  ANALYSIS  HAVE  BEEN 
CONSIDERED  MORE  EXTENSIVELY  THAN  MATTERS  OF  ITS  APPLICATION 
IN  PRACTICAL  SITUATIONS.  SINCE  ITS  RELATIONSHIPS  DIFFER  IN 
THEIR  APPLICABILITY,  THEY  MUST  BE  CONSIDERED  SEPARATELY  WHEN 
THEY  ARE  APPLIED.  IN  ORDER  TO  DO  THIS,  THE  FOUNDATIONS  OF 
THREE  SUCH  RELATIONSHIPS  ARE  EXAMINED  FROM  AN  E.MPIRICAL 
POINT  OF  VIEW.  TO  FURTHER  DEMONSTRATE  THE  INTIMATE 
CONNECTION  BETWEEN  DATA,  DEFINITIONS,  AND  PERFORMANCE 
MODELS,  THE  PROBLEM  OF  MEASUREMENT  IS  CONSIDERED. 
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ABSTRACT: 

A NUMBER  OF  PAPERS  HAVE  APPEARED  ON  THE  SUBJECT  OF  SOFTWARE 
SCIENCE;  CLAIMING  THE  EXISTENCE  OF  LAWS  RELATING  THE  SIZE  OF 
A PROGRAM  AND  THE  NUMBER  OF  OPERANDS  AND  OPERATORS  USED.  THE 
PRE-EMINENT  THEORY  WAS  DEVELOPED  BY  HALSTEAD  IN  1972.  THE 
THESIS  WORK  FOCUSES  ON  THE  EXAMINATION  OF  HALSTEAD’S  THEORY; 
WITH  AN  EMPHASIS  ON  HIS  FUNDAMENTAL  ASSUMPTIONS.  IN 
PARTICULAR,  THE  LENGTH  ESTIMATOR  WAS  ANALYZED  TO  DETERMINE 
WHY  IT  YIELDS  SUCH  A HIGH  VARIANCE;  THE  THEORETICAL 
FOUNDATIONS  OF  SOFTWARE  SCIENCE  HAVE  BEEN  EXTENDED  TO 
IMPROVE  THE  APPLICABILITY  OF  THE  CRITICAL  LENGTH  ESTIMATOR. 

THIS  ELABORATION  OF  THE  BASIC  THEORY  WILL  RESULT  IN 
GUIDELINES  FOR  THE  CREATION  OF  COUNTING  RULES  APPLICABLE  TO 
SPECIFIC  CLASSES  OF  PROGRAMS,  SO  THAT  IT  IS  POSSIBLE  TO 
DETERMINE  BOTH  WHEN  AND  HOW  SOFTWARE  SCIENCE  CAN  BE  APPLIED 
IN  PRACTICE. 
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ABSTRACT: 

THIS  TOOL  HAS  BEEN  DEVELOPED  TO  ASSIST  IN  THE  SOFTWARE 
VALIDATION  PROCESS.  P.A.P.A.  WILL  MEASURE  THE  COMPLEXITY  OF 
PROGRAMS  AND  DETECT  SEVERAL  PROGRAM  ANOMALIES.  THE  RESULTING 
LIST  OF  ANALYZED  PROGRAMS  IS  SORTED  IN  ORDER  OF  DESCENDING 
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COMPLEXITY.  SINCE  HIGH  COMPLEXITY  AND  ERROR-PRONENESS  ARE 
STRONGLY  RELATED,  THE  "CRITICAL”  PROGRAMS  WILL  BE  FOUND 
EARLIER  WITHIN  THE  DEVELOPMENT  CYCLE.  P.A.P.A.  PROVIDES 
SYNTAX  ANALYZERS  FOR  RPG(II/III),  PSEUDO  CODE  (DESIGN  AND 
DOCUMENTATION  LANGUAGE)  AND  PL/SIII  (WITHOUT  MACRO 
LANGUAGE).  IT  MAY  BE  APPLIED  DURING  THE  DESIGN-,  CODING-  AND 
TESTPHASE  OF  SOFTWARE  DEVELOPMENT  (E.G.  FOR  DESIGN-  AND  CODE 
INSPECTIONS). 
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ABSTRACT: 

THE  ERROR  RATE  OF  A SOFTWARE  APPLICATION  MAY  FUNCTION  AS  A 
MEASUREMENT  OF  CODE  QUALITY.  A METHODOLOGY  HAS  BEEN 
DEVELOPED  WHICH  ALLOWS  FOR  THE  ACCURATE  PREDICTION  OF  THE 
ERROR  RATE  AND  HENCE  CODE  QUALITY  PRIOR  TO  AN  APPLICATION’S 
RELEASE.  MANY  FACTORS  WERE  CONSIDERED  WHICH  COULD 
CONCEIVABLY  BE  RELATED  TO  THE  ERROR  RATE.  THESE  FACTORS  WERE 
DIVIDED  INTO  TWO  CATEGORIES:  THOSE  FACTORS  WHICH  VARY  WITH 
TIME,  AND  THOSE  FACTORS  WHICH  DO  NOT  VARY  WITH  TIME.  FACTORS 
WHICH  VARY  WITH  TIME  WERE  TERMED  ENVIRONMENTAL  FACTORS  AND 
INCLUDED  SUCH  ITEMS  AS:  NUMBER  OF  USERS,  ERRORS  SUBMITTED  TO 
DATE,  ETC.  FACTORS  WHICH  DO  NOT  VARY  WITH  TIME  WERE  TERMED 
INTERNAL  FACTORS  AND  INCLUDED  HALSTEAD  METRICS,  McCABE 
METRICS  AND  LINES  OF  CODE.  BECAUSE  THE  ERROR  RATE  OF  A 
SOFTWARE  PACKAGE  FLUCTUATES  GREATLY  WITH  TIME,  ENVIRONMENTAL 
FACTTORS  RATHER  THAN  INTERNAL  FACTORS  WERE  FIRST  STUDIED.  A 
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COMBINATION  OF  ENVIRONMENTAL  FACTORS  WERE  FOUND  TO  BE  HIGHLY 
CORRELATED  TO  THE  FLUCTUATIONS  OF  THE  ERROR  RATE.  WITH 
HISTORICAL  DATA,  REGRESSION  ANALYSIS  MAY  BE  RUN  TO  DETERMINE 
THE  COEFFICIENTS  FOR  EACH  ENVIRONMENTAL  FACTOR.  THE 
COEFFICIENT  MAY  BE  THOUGHT  OF  AS  A MEASURE  OF  THE  EFFECT 
EACH  ENVIRONMENTAL  FACTORS  HAS  ON  THE  ERROR  RATE.  EVERY 
APPLICATION  HAS  ITS  OWN  UNIQUE  COEFFICIENT  FOR  EACH 
ENVIRONMENTAL  FACTOR.  THESE  COEFFICIENTS  ARE  CONSTANT 
THROUGHOUT  THE  PERIOD  STUDIED.  SOFTWARE  SCIENCE  MEASURES 
WERE  GENERATED  FOR  EACH  APPLICATION.  THESE  MEASURES  WERE 
THEN  STUDIED  TO  DETERMINE  ANY  RELATIONSHIPS  BETWEEN  AN 
APPLICATION’S  COEFFICIENT  AND  ITS  SOFTWARE  SCIENCE  METRICS. 

THE  DIFFERENCES  IN  CERTAIN  OF  THE  APPLICATIONS  METRICS  WERE 
FOUND  TO  BE  HIGHLY  CORRELATED  TO  THE  DIFFERENCES  IN  THE 
APPLICATIONS  COEFFICIENT’S.  BY  UTILIZING  THE  METHODOLOGY 
OUTLINED  IN  THIS  PAPER,  IT  IS  POSSIBLE  TO  ACCURATELY 
ESTIMATE  THE  ERROR  RATE  OF  A SOFTWARE  PACKAGE  PRIOR  TO  ITS 
RELEASE  THROUGH  THE  UTILIZATION  OF  SOFTWARE  SCIENCE  METRICS. 
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THIS  PAPER  PRESENTS  A METHOD  FOR  DYNAMIC  MODIFICATION  OF 
OPERATING  SYSTEM  CONTROL  PARAMETERS  TO  IMPROVE  SYSTEM 
PERFORMANCE.  IMPROVED  PARAMETER  SETTINGS  ARE  LEARNED  BY 
EXPERIMENTING  ON  THE  SYSTEM.  THE  EXPERIMENTS  COMPARE  THE 
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PERFORMANCE  OF  ALTERNATIVE  PARAMETER  SETTINGS  IN  EACH  REGION 
OF  A PARTITIONED  LOAD-PERFORMANCE  SPACE  ASSOCIATED  WITH  THE 
SYSTEM.  THE  RESULTS  ARE  USED  TO  MODIFY  IMPORTANT  CONTROL 
PARAMETERS  PERIODICALLY,  RESPONDING  TO  FLUCTUATIONS  IN 
SYSTEM  LOAD  AND  PERFORMANCE.  THE  METHOD  CAN  BE  USED  TO 
IMPLEMENT  ADAPTIVE  TUNING,  TO  CHOOSE  BETWEEN  ALTERNATIVE 
ALGORITHMS  AND  POLICIES,  OR  TO  SELECT  THE  BEST  FIXED 
SETTINGS  FOR  PARAMETERS  WHICH  ARE  NOT  MODIFIED.  THE  METHOD 
WAS  VALIDATED  AND  PROVED  PRACTICAL  BY  AN  INVESTIGATION  OF 
TWO  PARAMETERS  GOVERNING  CORE  QUANTUM  ALLOCATION  ON  A SPERRY 
UNIVAC  1100  SYSTEM.  THIS  EXPERIMENT  YIELDED  SIGNIFICANT 
RESULTS,  WHICH  ARE  PRESENTED  AND  DISCUSSED.  DIRECTIONS  FOR 
FUTURE  RESEARCH  INCLUDED  AUTOMATING  THE  METHOD,  DETERMINING 
THE  EFFECT  OF  SIMULTANEOUS  MODIFICATIONS  TO  UNRELATED 
CONTROL  PARAMETERS,  AND  DETECTING  DOMINANT  CONTROL 
PARAMETERS. 
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ABSTRACT: 

THE  PERFORMANCE  OF  A DATABASE  SYSTEM  COMMONLY  DETERIORATES 
DUE  TO  DEGRADATION  OF  THE  DATABASE’S  PHYSICAL  DATA 
STRUCTURE.  THE  STRUCTURE  DEGRADATION  IS  A CONSEQUENCE  OF  THE 
NORMAL  OPERATIONS  OF  A GENERAL  DATABASE  MANAGEMENT  SYSTEM. 
WHEN  SYSTEM  PERFORMANCE  HAS  DEGRADED  BELOW  ACCEPTABLE  LIMITS 
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THE  DATABASE  MUST  BE  REORGANIZED.  IN  CONVENTIONAL,  PERIODIC 
REORGANIZATION  THE  DATABASE,  OR  PART  OF  IT,  IS  TAKEN  OFF 
LINE  WHILE  THE  DATA  STRUCTURE  IS  BEING  REORGANIZED.  THIS 
PAPER  PRESENTS  RESULTS  FROM  A STUDY  WHERE  IT  IS  SHOWN  THAT 
CONCURRENT  REORGANIZATION,  I.E.  A CONTINUOUS  REORGANIZATION 
OF  THE  PHYSICAL  DATA  STRUCTURE  WHILE  APPLICATION  PROCESSES 
HAVE  FULL  ACCESS  TO  THE  DATABASE,  IS  AN  ATTRACTIVE 
ALTERNATIVE  TO  CONVENTIONAL  REORGANIZATION.  THE  PAPER  ALSO 
PRESENTS  A SOLUTION  TO  A METHODOLOGICAL  PROBLEM  CONCERNING 
THE  SIMULATION  OF  A SYSTEM  WHICH  HAS  ACTIVITIES  WITH 
EXTREMELY  VARYING  DURATIONS. 
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ABSTRACT: 

WHAT  IS  EXPERIMENTAL  COMPUTER  SCIENCE?  THIS  QUESTION  HAS 
BEEN  WIDELY  DISCUSSED  EVER  SINCE  THE  FELDMAN  REPORT  WAS 
PUBLISHED  (1979).  MANY  COMPUTER  SCIENTISTS  BELIEVE  THAT 
SURVIVAL  OF  THEIR  DISCIPLUSTE  IS  INTIMATELY  LINKED  TO  THEIR 
ABILITY  TO  REJUVENATE  EXPERIMENTATION.  THE  NATIONAL  SCIENCE 
FOUNDATION  INSTITUTED  THE  COORDINATED  EXPERIMENTAL  RESEARCH 
PROGRAM(CERP)  IN  1979  TO  HELP  UNIVERSITIES  SET  UP  FACILITIES 
CAPABLE  OF  SUPPORTING  EXPERIMENTAL  RESEARCH.  OTHER  AGENCIES 
OF  GOVERNMENT  ARE  CONSIDERING  SIMILAR  PROGRAMS.  SOME 
INDUSTRIAL  FIRMS  ARE  OFFERING  SIMILAR  HELP  THROUGH  MODEST 
CASH  GRANTS  AND  EQUIPMENT  DISCOUNTS.  WHAT  IS  EXPERIMENTAL 
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COMPUTER  SCIENCE?  SURPRISINGLY,  COMPUTER  SCIENTISTS  DISAGREE 
ON  THE  ANSWER.  A FEW  BELIEVE  THAT  COMPUTER  SCIENCE  IS  IN 
FLUX  — MAKING  A TRANSITION  FROM  THEORETICAL  TO  EXPERIMENTAL 
SCIENCE  — AND,  HENCE,  NO  OPERATIONAL  DEFINITION  IS  YET 
AVAILABLE.  SOME  BELIEVE  THAT  IT  IS  ALL  THE  NON-THEORETICAL 
ACTIVITIES  OF  COMPUTER  SCIENCE,  ESPECIALLY  THOSE  CONFERRING 
"HAND-ON”  EXPERIENCE.,  QUITE  A FEW  BELIEVE  THAT  IT  IS  LARGE 
SYSTEM  DEVELOPMENT  PROJECTS  — I.E.,  COMPUTER  AND  SOFTWARE 
ENGINEERING  — AND  THEY  CITE  MIT’S  MULTICS,  BERKELEY’S 
VERSION  OF  BELL  LAB’S  UNIX,  THE  ARPANET,  IBM’S  DATABASE 
SYSTEM  R,  AND  XEROX’S  ETHERNET-BASED  PERSONAL  COMPUTER 
NETWORK  AS  EXAMPLES.  THESE  BELIEVES  ARE  WRONG.  THERE  ARE 
WELL-ESTABLISHED  STANDARDS  FOR  EXPERIMENTAL  SCIENCE.  THE 
FIELD  OF  PERFORMANCE  EVALUATION  MEETS  THESE  STANDARDS  AND 
PROVIDES  EXAMPLES  OF  EXPERIMENTAL  SCIENCE  FOR  THE  REST  OF 
THE  COMPUTING  FIELD. 
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A DESCRIPTION  OF  THE  DESIGN  AND  IMPLEMENTATION  OF  A LOG  FILE 
FOR  ANALYZING  THE  OCCUPANCY  OF  SECONDARY  STORAGE  ON  IBM 
COMPUTER  SYSTEMS  IS  DISCUSSED.  TYPICAL  APPLICATIONS  OF  THE 
DATA  CONTAINED  IN  THE  LOG  ARE  ALSO  DISCUSSED. 
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ABSTRACT: 

THIS  CASE  STUDY  ILLUSTRATES  HOW  TWO  CAPABILITIES  RELATIVELY 
RECENTLY  INTRODUCED  INTO  QUEUEING  NETWORK  MODELS  — MULTIPLE 
JOB  CLASSES  AND  SUBNETWORK  COLLAPSE  — GREATLY  SIMPLIFY  THE 
FORMULATION  AND  ANALYSIS  OF  QUEUEING  NETWORK  MODELS  OF 
COMPUTER  SYSTEM.  THE  GOAL  OF  THE  STUDY  WAS  TO  ANALYZE 
COMPETITIVE  EFFECTS  BETWEEN  THREE  CLASSES  OF  JOBS  IN  TERMS 
OF  RESPONSE  TIMES.  RESOLUTION  OF  THE  WORKLOAD  INTO  SEPARATE 
CLASSES  OF  JOBS  IS  OBVIOUSLY  REQUIRED.  THE  ROLE  OF  NETWORK 
COLLAPSE  IS  TO  CONVERT  THE  COMPUTATION  OF  RESPONSES,  WHICH 
REQUIRES  PATH  FOLLOWING  OF  A JOB  THROUGH  A PERHAPS  COMPLEX 
SUBNETWORK  TRAVERSAL  INTO  THE  READING  OF  A SINGLE  NUMBER, 

THE  WAIT  TIME  FOR  A COMPOSITE  QUEUE.  SOME  OF  THE  PITFALLS 
AND  PROBLEMS  TO  BE  AVOIDED  OR  CIRCUMVENTED  IN  THE  CASE  OF 
REPRESENTATIVE  COMMERCIAL  QUEUEING  NETWORK  MODELING  PACKAGES 
ARE  DISCUSSED. 

KEYWORDS: 

QUEUEING  NETWORK  MODELS  * NETWORK  * PERFORMANCE  EVALUATION 
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TITLE: 

SIMULATION  OF  A DISTRIBUTED  SYSTEM  FOR  PERFORMANCE  MODELING 
AUTHOR(s): 

BENNETT,  DAVID  A.  * LANDAUER,  CHRISTOPHER  A. 

AFFILIATION: 

PATTERN  ANALYSIS  AND  RECOGNITION  CORPORATION 
ABSTRACT: 

A DISTRIBUTED  SYSTEM  OF  COOPERATING  MINICOMPUTERS  IS 
SIMULATED  BY  AIMER  (AUTOMATIC  INTEGRATION  OF  MULTIPLE 
ELEMENT  RADARS)  TO  MODEL  AND  ANALYZE  THE  BEHAVIOR  OF  A RADAR 
TRACKING  SYSTEM.  SIMULATION  IS  APPLIED  IN  THE  AIMER  PROJECT 
IN  AN  ATTEMPT  TO  MODEL  A NETWORK  OF  MINICOMPUTERS  TO 
DISCOVER  A MAXIMALLY  FLEXIBLE  NETWORK  ARCHITECTURE.  BECAUSE 
BUILDING  THE  TRACKING  SYSTEM  OUT  OF  REAL  HARDWARE  WOULD  NOT 
RESULT  IN  A FLEXIBLE  ENOUGH  TESTBED  SYSTEM,  THE  PROPOSED 
CONFIGURATION  IS  REPRESENTED  BY  A SOFTWARE  EMULATION.  THE 
INSTRUCTION  SETS  OF  THE  INDIVIDUAL  PROCESSORS  ARE  EMULATED 
IN  ORDER  TO  ALLOW  SEPARATION  OF  THE  MEASUREMENT  FACILITIES 
FROM  THE  EXECUTION  OF  THE  SYSTEM.  THE  EMULATION  IS  SUPPORTED 
BY  A NANO-DATA  QM-1  MICRO  AND  NANO-PROGRAMMABLE  HOST. 
EXTENSIVE  PERFORMANCE  MONITORING  HOOKS  HAVE  BEEN  BUILT  INTO 
THE  EMULATION  SYSTEM  WHILE  ALLOW  SMALL  PERFORMANCE 
PERTURBATIONS  TO  BECOME  VISIBLE.  THE  TRACKING  NETWORK  IS 
CONTROLLED  BY  A COMBINATION  FIRMWARE  OPERATING  SYSTEM  AND  A 
SPECIAL  EMULATED  VIRTUAL  CONTROL  MACHINES  WHOSE  INSTRUCTION 
SETS  AND  COMPUTATIONAL  THROUGHPUT  CAN  BE  PARAMETERIZED  WHEN 
THE  MODEL  IS  GENERATED,  OR  DYNAMICALLY  BY  AN  OPERATOR  DURING 
A RUN.  THE  RADAR  AND  GROUND  TRUTH  ENVIRONMENTS  FOR  THE 
TRACKING  SYSTEM  ARE  SIMULATED  WITH  LOGIC  RESIDENT  IN  ONE  OF 
THE  EMULATED  MACHINES,  ALLOWING  THESE  FUNCTIONS  TO  BE 
MONITORED  AS  ACCURATELY  AS  THE  TRACKING  ALGORITHMS.  THE  USE 
OF  THIS  SIMULATION  TECHNIQUE  HAS  RESULTED  IN  AN  EXTREMELY 
FLEXIBLE  TESTBED  FOR  THE  DEVELOPMENT  OF  DISTRIBUTED  RADAR 
TRACKING  SYSTEM  MODELS.  THE  TESTBED  ITSELF  CAN  BE  QUICKLY 
TAILORED  TO  OTHER  APPLICATION  PROBLEMS. 

KEYWORDS: 
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TITLE: 

THE  BENCHMARKING,  TUNING  AND  ANALYTIC  MODELING  OF  VAX/VMS 
AUTHOR(s): 

LAZOWSKA,  EDWARD  D. 

AFFILIATION: 

UNIVERSITY  OF  WASHINGTON 
ABSTRACT: 

THIS  PAPER  DESCRIBES  A RECENT  EXPERIENCE  IN  BENCHMARKING, 

TUNING  AND  MODELING  DIGITAL  EQUIPMENT  CORPORATION’S  VMS 
EXECUTIVE  RUNNING  ON  THEIR  VAX-11/780  COMPUTER.  ALTHOUGH  WE 
EMPHASIZE  MODELING  HERE,  THE  THREE  ASPECTS  ARE  CLOSELY 
INTERRELATED.  THE  BENCHMARKING  AND  TUNING  EFFORTS  ARE  OF 
INTEREST  BECAUSE:  (l)  THEY  WERE  CONDUCTED  WITHOUT  SPECIAL 
TOOLS,  USING  ONLY  THE  SCRIPT  DRIVER  AND  MEASUREMENT  PACKAGES 
DELIVERED  WITH  THE  SYSTEM.  (2)  THEY  REVEALED  SEVERAL 
SIGNIFICANT  ASPECTS  OF  SYSTEM  BEHAVIOR  THAT  IN  ALL 
PROBABILITY  WOULD  HAVE  BEEN  ABSTRACTED  AWAY  IN  THE  COURSE  OF 
THE  MODELING  EFFORT,  HAD  IT  NOT  BEEN  PRECEDED  BY  DETAILED 
BENCHMARKING  AND  TUNING.  (3)  A FOUR-FOLD  AVERAGE  IMPROVEMENT 
IN  BENCHMARK  PERFORMANCE  WAS  ACHIEVED,  WITH  GREATER 
IMPROVEMENT  FOR  SPECIFIC  CUSTOMER  CLASSES.  THE  MODELING 
EFFORTS  IS  OF  INTEREST  BECAUSE:  (l)  CONVENTIONAL 
HIERARCHICAL  MODELING  TECHNIQUES  ARE  NOT  DIRECTLY  APPLICABLE 
TO  A SYSTEM  IN  WHICH  A SINGLE  DISK  IS  USED  FOR  PAGING, 

SWAPPING,  AND  USER  I/O  ACTIVITY.  IN  PARTICULAR,  SWAPPING  IS 
SIGNIFICANT  BOTH  AT  A HIGH  LEVEL,  WHERE  IT  DELAYS  A 
CUSTOMER’S  ADMISSION  TO  THE  MULTIPROGRAMMING  SET,  AND  AT  A 
LOW  LEVEL,  WHERE  IT  AFFECTS  THE  THROUGHPUT  OF  PAGING  AND 
USER  I/O  REQUESTS.  (2)  THE  MULTIPLICITY  OF  MEMORY  MANAGEMENT 
MECHANISMS  IN  VMS  LEAD  TO  BEHAVIOR  THAT  IS  DIFFICULT  TO 
COMPREHEND,  FURTHER  INCREASING  THE  CHALLENGE  IN  CALCULATING 
LOAD-DEPENDENT  THROUGHPUT  RATES.  (3)  THE  RESULTING  MODEL 
DEMONSTRATES  GOOD  AGREEMENT  WITH  MEASURED  PERFORMANCE  OVER  A 
FAIRLY  WIDE  RANGE  OF  CONDITIONS. 
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TITLE: 

A TECHNIQUE  FOR  INTEGRATING  SIMULATION  AND  SYSTEM  DESIGN 

AUTHOR(s): 

SANGUINETTI,  JOHN 

AFFILIATION: 

DIGITAL  EQUIPMENT  CORPORATION 
ABSTRACT: 

A TECHNIQUE  FOR  SIMULATING  INCOMPLETE  SYSTEMS  IS  GIVEN  WHICH 
ALLOWS  PERFORMANCE  PREDICTION  DURING  SYSTEM  DESIGN.  THIS 
TECHNIQUES,  CALLED  INTEGRATED  SIMULATION,  ALLOWS  THE  SYSTEM 
DESIGN  TO  ITSELF  BE  A SIMULATION,  THUS  AVOIDING  THE  OVERHEAD 
OF  MAINTAINING  A SEPARATE,  VALID  SIMULATION  MODEL  FOR  THE 
SYSTEM.  THE  PAPER  PRESENTS  INTEGRATED  SIMULATION  IN  THE 
FRAMEWORK  OF  A SYSTEM  MODELING  LANGUAGE  CALLED  THE  PROGRAM 
PROCESS  MODELING  LANGUAGE,  PPML.  THIS  LANGUAGE  PROVIDES  A 
MEANS  FOR  DESCRIBING  SYSTEMS  OF  CONCURRENT  PROCESSES  IN  BOTH 
ABSTRACT  AND  EXPLICIT  TERMS,  THUS  LEADING  ITSELF  WELL  TO  A 
TOP-DOWN  DESIGN  METHOD.  IN  THE  DESIGN  PROCESS,  ANY  PPML 
REPRESENTATION  OF  THE  SYSTEM  CAN  BE  SIMULATED  DIRECTLY,  FROM 
THE  MOST  ABSTRACT  DESIGN  TO  THE  COMPLETELY  ELABORATED 
SYSTEM.  SIMULATION  OF  THE  COMPLETELY  ELABORATED  SYSTEM  IS, 

IN  FACT,  SIMPLY  THE  SYSTEM  IN  EXECUTION.  THE  PAPER  DEFINES 
PPML  AND  DESCRIBES  THE  TECHNIQUES  REQUIRED  TO  SIMULATE  PPML 
SYSTEMS  GIVEN  VARIOUS  UNDERLYING  MACHINES.  IT  INCLUDES,  WITH 
A DISCUSSION  OF  THE  LIMITATIONS  OF  THE  INTEGRATED  SIMULATION 
METHOD. 
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TITLE: 

PERFORMANCE  SPECIFICATIONS  AND  ANALYSIS  OF  SOFTWARE  DESIGNS 
AUTHOR(s): 

SMITH,  CONNIE  ♦ BROWNE,  J.  C. 

AFFILIATION: 

DEPARTMENT  OF  COMPUTER  SCIENCES,  UNIVERSITY  OF  TEXAS,  AUSTIN 
ABSTRACT: 

A METHODOLOGY  IS  DEFINED  THAT  WILL  INTEGRATE  THE  SOFTWARE 
DEVELOPMENT  PROCESS  WITH  COMPUTER  PERFORMANCE  EVALUATION  AND 
CAPACITY  PLANNING  PROCESSES.  SYSTEMS  ANALYSTS  PROVIDE 
SPECIFICATIONS  ON  EXECUTION  CHARACTERISTICS  OF  SOFTWARE 
DESIGNS  AND  EVALUATE  THEM  WITH  RESPECT  TO  PERFORMANCE  GOALS. 
THE  PROCESS  IS  REPEATED,  AS  IMPLEMENTATION  PROCEEDS,  TO 
MONITOR  THE  PERFORMANCE  THROUGHOUT  SOFTWARE  DEVELOPMENT. 
PERFORMANCE  CRISES  CAN  BE  AVERTED  BY  PROPER  CONSIDERATION  OF 
SOFTWARE  IMPACT  PRIOR  TO  IMPLEMENTATION.  THE  DATA  OBTAINED 
CAN  BE  USED  BY  PERFORMANCE  ANALYSTS  FOR  MORE  ACCURATE 
LONG-RANGE  PLANNING. 
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WHICH  (A)  A SINGLE  INTEGRATED  INTERACTIVE  APPLICATION  IS  TO 
SPAN  A DISTRIBUTED  CONFIGURATION  OF  COMPUTING  HARDWARE,  (B) 

THE  CONFIGURATION  IS  UNKNOWN  WHEN  THE  BENCHMARK  IS  BEING 
DEVELOPED,  AND  (C)  THE  APPLICATION  TO  SOFTWARE  WILL  BE 
WRITTEN  AFTER  THE  BENCHMARK  HAS  BEEN  RUN.  THE  BUYER  PREPARES 
A SIMULATION  MODEL  OF  THE  INTENDED  APPLICATION  IN  THE  FORM 
OF  PROGRAMS  THAT  WILL  RUN  ON  THE  HARDWARE  BEING  BENCHMARKED. 
EACH  COMPETING  VENDOR  IS  EXPECTED  TO  TUNE  THE  PERFOR-  MANCE 
OF  THIS  MODEL  TO  THE  HARDWARE  CONFIGURATION  THAT  HE  HAS 
PROPOSED,  SO  HE  WILL  REQUIRE  SEVERAL  VERSIONS  OF  THE  MODEL. 

THIS  PRESENTS  THE  BUYER  WITH  A FORMIDABLE 

SOFTWARE-PRODUCTION  PROBLEM,  WHICH  IS  FURTHER  COMPLICATED  BY 
A REQUIREMENT  FOR  EXTREME  FLEXIBILITY  AND  RELIABILITY.  THE 
PAPER  ADDRESSES  THE  SOFTWARE-PRODUCTION  PROBLEM  AND 
DESCRIBES  ITS  SOLUTION.  THE  SOLUTION  WAS  TO  DEVELOP  AN 
AUTOMATED  CODE-PRODUCTION  SYSTEM  BASED  ON  TWO  PRINCIPAL 
DESIGN  FEATURES.  FIRST,  THE  MODEL  AND  ITS  TRANSLATOR  ARE 
BOTH  WRITTEN  IN  THE  SAME  LANGUAGE;  SECONDLY,  THE  COMMON 
LANGUAGE  IS  SELECTED  ON  THE  BASIS  OF  READABILITY  AND 
EXTENSIBILITY.  THE  PAPER  EXAMINES  WHY  THIS  APPROACH  TO  THE 
CODE-PRODUCTION  PROBLEM  WAS  SUCCESSFUL.  THOUGH  THE 
CODE-PRODUCTION  SYSTEM  WAS  DEVELOPED  TO  SUPPORT  A PARTICULAR 
BENCHMARKING  APPROACH,  IT  SHOULD  ALSO  BE  USEFUL  IN  OTHER 
MODELING  SITUATIONS.  INDEED  IT  MIGHT  BE  OF  INTEREST  IN  ANY 
FIELD  WHERE  READABILITY,  RELIABILITY,  EASE  OF  MAINTENANCE,  . 

AND  ECONOMY  OF  PROGRAMMING  EFFORT  ARE  CONSIDERED  IMPORTANT. 
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ABSTRACT: 

COMPUTER  EVALUATION,  COMPARISON,  AND  SELECTION  IS 
ESSENTIALLY  A DECISION  PROCESS.  THE  DECISION  MAKING  IS  BASED 
ON  A NUMBER  OF  WORTH  INDICATORS.  THE  PERFORMANCE  INDICATORS 
ARE  OBTAINED  THROUGH  THE  COMPUTER  PERFORMANCE  MEASUREMENT 
PROCEDURE.  CONSEQUENTLY,  THIS  PROCEDURE  SHOULD  BE  COMPLETELY 
CONDITIONED  BY  THE  DECISION  PROCESS.  THIS  PAPER  INVESTIGATES 
VARIOUS  ASPECTS  OF  COMPUTER  PERFORMANCE  MEASUREMENT  AND 
EVALUATION  PROCEDURE  WITHIN  THE  CONTEXT  OF  COMPUTER 
EVALUATION,  COMPARISON  AND  SELECTION  PROCESS  BASED  ON  THE 
LOGIC  SCORING  OF  PREFERENCE  METHOD.  THE  SET  OF  ELEMENTARY 
CRITERIA  FOR  PERFORMANCE  EVALUATION  IS  PROPOSED  AND  THE 
CORRESPONDING  SET  OF  PERFOR-  MANCE  INDICATORS  IS  DEFINED. 

THE  NECESSARY  PERFORMANCE  MEASUREMENTS  ARE  BASED  ON  THE 
STANDARDIZED  SET  OF  SYNTHETIC  BENCHMARK  PROGRAMS  AND  INCLUDE 
THREE  SEPARATE  MEASUREMENTS:  MONOPROGRAMMING  PERFORMANCE 
MEASUREMENT,  MULTIPROGRAMMING  PERFORMANCE  MEASUREMENT,  AND 
MULTIPROGRAMMING  EFFICIENCY  MEASUREMENT.  USING  THE  PROPOSED 
ELE.MENTARY  CRITERIA,  THE  MEASURED  PERFOR-  MANCE  INDICATORS 
CAN  BE  TRANSFORMED  INTO  ELEMENTARY  PREFERENCES  AND 
AGGREGATED  WITH  OTHER  NON-PERFORMANCE  ELEMENTARY  PREFERENCES 
OBTAINED  THROUGH  THE  EVALUATION  PROCESS.  THE  APPLICABILITY 
OF  PRESENTED  ELEMENTARY  CRITERIA  IS  ILLUSTRATED  BY  NUMERICAL 
EXAMPLES. 

KEYWORDS: 
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SYSTEM  MODELING  * MONOPROGRAMMING  * MULTIPROGRAMMING 

CATEGORIES: 

3.51  * 3.8  » 4.19  » 4.32  ♦ 4.6  » 8.3 


REFERENCE  CODE:  142 

JOURNAL: 

ACM-SIGMETRICS  / THE  7TH  IFIP  W.G.7.3,  PERFORMANCE  80 
(PROCEEDINGS  OF  PERFORMANCE  80  , PERFORMANCE  EVALUATION 
REVIEW) 

VOLUME:  9 

ISSUE:  2 

DATE:  JUNE  1980 
PAGES:  11  - 25 

TITLE: 

XRAY:  INSTRUMENTATION  FOR  MULTIPLE  COMPUTERS 

AUTHOR(s): 

BLAKE,  RUSS 

AFFILIATION: 


- 101  - 


TANDEM  COMPUTER  INC. 


ABSTRACT: 

XRAY  PRESENTS  A GLOBAL  VIEW  OF  THE  PERFORMANCE  OF  HARDWARE 
AND  SOFTWARE  COMPONENTS  ON  MULTIPLE,  DISTRIBUTED  COMPUTERS. 
THE  SET  OF  COMPUTERS  CHOSEN  FOR  MEASUREMENT  CAN  BE  CHANGED 
AT  ANY  TIME  THROUGHOUT  A NETWORK  OF  SYSTEMS,  AND  CAN  BE 
SELECTED  TO  MINIMIZE  DATA  COLLECTION  TIME  AND  MEASUREMENT 
SPACE.  IN  THE  COURSE  OF  NORMAL  ACTIVITIES  THE  OPERATING 
SYSTEM  EXECUTES  FIRMWARE  WHICH  INCREMENTS  COUNTERS  FOR  THE 
MEASURED  COMPONENTS.  PERIODICALLY,  THE  COUNTERS  ARE  RECODED 
IN  AN  ORDINARY  FILE  BY  A PROCESS  IN  EACH  PROCESSOR.  AN 
ANALYSIS  PROGRAM  PERMITS  BROWSING  THROUGH  COMPONENTS  AND 
PLOTTING  COUNTERS  IN  REAL  TIME.  ANALYSIS  FOCUSES  ON 
DETECTING  THE  DISTRIBUTED  SOURCES  OF  EXCESSIVE  ACTIVITY. 

KEYWORDS: 

PERFORMANCE  EVALUATION  * REAL  TIME  SYSTEM  * NETWORK  * 
DISTRIBUTED  NETWORK 
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BENCHMARKING  INTERACTIVE  SYSTEMS:  CALIBRATING  THE  MODEL 
AUTHOR(s): 

BASHIOUM,  DOUGLAS  L. 

AFFILIATION: 

THE  MITRE  CORPORATION,  METREK  DIVISION 
ABSTRACT: 

A METHODOLOGY  FOR  BENCHMARKING  DEDICATED,  INTERACTIVE 
SYSTEMS  HAS  BEEN  DEVELOPED  AT  THE  MITRE  CORPORATION.  THIS 
METHODOLOGY  USES  A SYNTHETIC  PROGRAM  MODEL  OF  THE 
APPLICATION  WHICH  RUNS  ON  THE  PROPOSED  HARDWARE  / OPERATING 
SYSTEM  CONFIGURATIONS  AND  IS  DRIVEN  BY  A STATISTICALLY 
DERIVED  LOAD.  SYSTEM  PERFORMANCE  IS  MEASURED  BY  ANALYZING 
THE  SYNTHETIC  TRANS-  ACTION  RESPONSE  TIMES.  THE  METHODOLOGY 
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YIELDS  ASSURANCES  TO  A BUYER  THAT  THE  BENCHMARKED  SYSTEM  HAS 
AT  LEAST  AN  A PRIORI  DEFINED  AMOUNT  OF  COMPUTER  POWER 
AVAILABLE  FOR  APPLICATIONS  ORIENTED  SOFTWARE.  THIS  PAPER 
EXAMINES  THE  METHODOLOGY  AND  THE  PROBLEMS  THAT  WERE 
ENCOUNTERED  AND  SOLUTIONS  WHICH  HAS  BEEN  USED  IN  CALIBRATING 
A BENCHMARK  MODEL  FOR  A SPECIFIC  APPLICATION.  THE  BENCHMARK 
WAS  DESIGNED  TO  MODEL  A LARGE  INTERACTIVE  INFORMATION 
PROCESSING  APPLICATION  ON  A PROCUREMENT  REQUIRING 
LOOSELY-COUPLED  (NO  SHARED  MEMORY)  MULTI-COMPUTER  SYSTEMS. 
THE  MODEL  CONSISTS  OF  A SET  OF  INTERACTING  SYNTHETIC  PROGRAM 
CELLS,  E.ACH  COMPOSED  OF  SEVERAL  ABSTRACTLY  DEFINED 
COMPONENTS.  THE  MODEL  IS  MAINTAINED  IN  A VERY  HIGH  LEVEL 
LANGUAGE  THAT  IS  AUTOMATICALLY  TRANSLATED  INTO  A STANDARD 
HIGH  ORDER  LANGUAGE  (TYPICALLY  FORTRAN  OR  COBOL)  FOR 
DELIVERY  TO  THE  COMPETING  VENDORS.  THESE  DELIVERED  MODEL 
CELLS  CONTAIN  AUTOMATICALLY  GENERATED  SIZE  AND  TIME  FILLER 
CODE  THAT  "CALIBRATE”  THE  CELLS  TO  CONSUME  THE  APPROPRIATE 
CPU  TIME  AND  MEMORY  SPACE  AS  DEFINED  BY  THE  ABSTRACT  SIZE 
UNITS  AFTER  ACCOUNTING  FOR  EACH  VENDOR’S  HARDWARE  AND 
PROPOSED  SYSTEM  DESIGN. 
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ABSTRACT: 

PROGRAM  BEHAVIOUR  CHARACTERISTICS  WERE  EXAMINED  USING  DATA 
GATHERED  FROM  REAL  PROGRAM  EXECUTIONS.  EXPERIMENTS  WERE 
PERFORMED  IN  A SEGMENTED  VIRTUAL  MEMORY  WITH  A WORKING  SET 
POLICY;  THE  ANALYZING  COSTS  WERE  KEPT  LOW  USING  AN  EFFICIENT 
DATA  REDUCTION  METHOD.  EMPIRICAL  RESULTS  WERE  OBTAINED 
CONCERNING  THE  INFLUENCE  OF  THE  WINDOW  SIZE  ON  PROGR.AM 
BEHAVIOUR  CHARACTERISTICS,  THE  ACCURACY  OF  SOME  AVERAGE 
WORKING  SET  SIZE  APPROXIMATIONS  AND  THE  SENSITIVITY  OF 
PROGRAM  BEHAVIOUR  TO  THE  PROGRAM’S  INPUT  DAT.A.  THESE  RESULTS 
SHOW  THAT  SOME  COMMONLY  USED  ASSUMPTIONS  CONCERNING  PROGRAM 
BEHAVIOUR  ARE  INACCURATE.  ALSO  THERE  SEEM  TO  EXIST 
”ILL-BEHAVING”  PROGRAMS,  THE  BEHAVIOUR  OF  WHICH  DOES  NOT- 
CORRESPOND  WELL  WITH  RESULTS  OBTAINED  EARLIER.  THE  EFFECTS 
OF  REAL-TIME  DELAYS  DURING  PROGRAM  EXECUTION  WERE  CONSIDERED 
USING  A NEW  SIMPLE  METHOD.  AS  AN  ADDITIONAL  EXPERIMENT,  SEG- 
MENTING AND  PAGING  WERE  COMPARED  USING  VARIOUS  PERFORMANCE 
STATISTICS;  THE  RESULTS  SEEM  TO  FAVOR  SEGMENTING. 

KEYWORDS: 
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RESPONSE  TIMES  AND  THROUGHPUTS.  ADVANTAGES  AND  DISADVANTAGES 
OF  USING  THE  MODELING  APPROACH  ARE  ALSO  BRIEFLY  DISCUSSED. 
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ABSTRACT: 

THIS  PAPER  EXTENDS  PREVIOUS  WORK  ON  DEVELOPMENT  OF  A 
METHODOLOGY  FOR  THE  PREDICTION  OF  THE  PERFORMANCE  OF 
COMPUTER  SOFTWARE  SYSTEMS  FROM  DESIGN  LEVEL  SPECIFICATIONS 
AND  CONTINUING  THROUGH  IMPLEMENTATION.  THE  EFFECTS  OF 
SYNCHRONIZED  BEHAVIOR,  SUCH  AS  RESULTS  FROM  DATA  RESERVATION 
IN  MULTI-  THREAD  EXECUTIONS  OF  DATA  BASE  SYSTEMS,  AND 
COMPETITION  FOR  HOST  SYSTEM  RESOURCES  ARE  INCORPORATED.  THE 
PREVIOUS  METHODOLOGY  USES  HIERARCHICAL  GRAPHS  TO  REPRESENT 
THE  EXECUTION  OF  SOFTWARE  ON  SOME  HOST  COMPUTER  SYSTEM  (OR 
ON  SOME  ABSTRACT  MACHINE).  PERFORMANCE  METRICS  SUCH  AS 
RESPONSE  TIME  WERE  OBTAINED . FROM  ANALYSIS  OF  THESE  GRAPHS 
ASSUMING  EXECUTION  OF  A SINGLE  COPY  ON  A DEDICATED  HOST. 

THIS  PAPER  DISCUSSES  THE  MAPPING  OF  THESE  EXECUTION  GRAPHS 
UPON  QUEUEING  NETWORK  MODELS  OF  THE  HOST  COMPUTING 
ENVIRONMENT  TO  YIELD  PERFORMANCE  METRIC  ESTIMATES  FOR  MORE 
COMPLEX  AND  REALISTIC  PROCESSING  ENVIRONMENTS. 
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ABSTRACT: 

WE  CONSIDER  THE  EFFECT  ON  SYSTEM  PERFORMANCE  OF  THE 
DISTRIBUTION  OF  A DATA  BASE  IN  THE  FORM  OF  MULTIPLE  COPIES 
AT  DISTINCT  SITES.  THE  PURPOSE  OF  OUR  ANALYSIS  IS  TO 
DETERMINE  THE  GAIN  IN  READ  THROUGHPUT  THAT  CAN  BE  OBTAINED 
IN  THE  PRESENCE  OF  CONSISTENCY  PRESERVING  ALGORITHMS  THAT 
HAVE  TO  BE  IMPLEMENTED  WHEN  UPDATE  OPERATIONS  ARE  CARRIED 
OUT  ON  EACH  COPY.  WE  SHOW  THAT  READ  THROUGHPUT  DIMINISHES  IF 
THE  NUMBER  OF  COPIES  EXCEEDS  AN  OPTIMAL  VALUE.  THE 
THEORETICAL  MODEL  WE  DEVELOP  IS  APPLIED  TO  A SYSTEM  IN  WHICH 
CONSISTENCY  IS  PRESERVED  THROUGH  THE  USE  OF  ELLIS’S  RING 
ALGORITHM. 
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ABSTRACT: 

THE  TASK  OF  MODELING  THE  PERFORMANCE  OF  A SINGLE  COMPUTER 
(HOST)  WITH  ASSOCIATED  PERIPHERAL  DEVICES  IS  NOW  WELL 
UNDERSTOOD.  IN  FACT,  HIGHLY  USABLE  TOOLS  BASED  ON  ANALYTICAL 
MODELING  TECHNIQUES  ARE  COMMERCIALLY  AVAILABLE  AND  IN 
WIDESPREAD  USE  THROUGHOUT  THE  INDUSTRY.  THESE  TOOLS  PROVIDE 
A MECHANISM  FOR  DESCRIBING  COMPUTERIZED  MANNER.  THIS  IS 
IMPORTANT  BECAUSE  IT  ALLOWS  USERS  TO  DESCRIBE  THEIR  COMPUTE 
ENVIRONMENTS  IN  A STRUCTURED  WAY  THAT  AVOIDS  UNNECESSARY 
COMPLEXITY.  IT  ALSO  IS  HELPFUL  IN  FACILITATING  INTUITIVE 
INTERPRETATIONS  OF  MODELING  RESULTS  AND  APPLYING  THEM  TO 
CAPACITY  PLANNING  DECISIONS.  A FIRST  STEP  TOWARD  BUILDING  A 
MODELING  TOOL  AND  ASSOCIATED  NETWORK  SPECIFICATION  LANGUAGE 
THAT  ALLOWS  STRAIGHTFORWARD,  INEXPENSIVE,  AND  INTERPRETABLE 
MODELING  OF  MULTI-COMPUTER  NETWORK  PERFORMANCE  IS  TO 
IDENTIFY  THE  SET  OF  CHARACTERISTICS  (PARAMETERS)  THAT  MOST 
HEAVILY  INFLUENCE  THAT  PERFORMANCE.  THE  RESULT  OF  SUCH  A 
STUDY  FOR  THE  COMMUNICATION  ASPECTS  OF  LOCAL  AREA  NETWORKS 
IS  THE  SUBJECT  OF  THIS  PAPER. 
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THIS  PAPER  DESCRIBES  THE  PROCESS  OF  BENCHMARKING  THE  DIVERSE 
RESEARCH  ENVIRONMENT  THAT  CONSTITUTES  THE  WORKLOAD  OF 
VAX/VMS  AT  THE  UNIVERSITY  ANALYSIS  AND  CONTROL  CENTER  AT 
NORTH  CAROLINA  STATE  UNIVERSITY.  THE  BENCHMARKING  PROCESS 
BEGAN  WITH  A STUDY  OF  THE  SYSTEM  LOADING  AND  PERFORMANCE 
CHARACTERISTICS  OVER  THE  SIX-MONTH  PERIOD  FROM  JANUARY  TO 
JUNE  OF  1981.  STATISTICS  WERE  COMPILED  ON  THE  NUMBER  OF 
ACTIVE  USERS,  CPU  USAGE  BY  INDIVIDUAL  ACCOUNTS,  AND  PEAK 
LO.AD  PERIODS.  INDIVIDUAL  USERS  WERE  INTERVIEWED  TO  DETERMINE 
THE  NATURE  AND  MAJOR  COMPUTING  CHARACTERISTICS  OF  THE 
RESEARCH  THEY  WERE  CONDUCTING  ON  VAX.  INFORMATION  FROM  ALL 
SOURCES  WAS  COMPILED  TO  PRODUCE  A BENCHMARK  THAT  CLOSELY 
PARALLELED  ACTUAL  SYSTEM  ACTIVITY.  AN  ANALYTIC  MODEL  WAS 
INTRODUCED  AND  USED  IN  CONJUNCTION  WITH  THE  BENCHMARK  DATA 
AND  HARDWARE  CHARACTERISTICS  TO  DERIVE  PERFORMANCE  MEASURES 
FOR  THE  SYSTEM.  COMPARISONS  WITH  MEASURED  SYSTEM  PERFORMANCE 
WERE  CONDUCTED  TO  DEMONSTRATE  THE  ACCURACY  OF  THE  MODEL.  THE 
MODEL  WAS  THEN  EMPLOYED  TO  PREDICT  PERFORMANCE  AS  THE  SYSTEM 
WORKLOAD  WAS  INCREASED,  TO  SUGGEST  IMPROVEMENTS  FOR  THE 
SYSTEM,  AND  TO  EXAMINE  THE  EFFECTS  OF  THOSE  LMPROVEMENTS. 
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PERFORMANCE  EVALUATION  ♦ BENCHMARKING  * SYSTEM  MODELING  * 
SYSTEMS  ANALYSIS 
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INSTRUCTION  MULTIPLE  DATA)  COMPUTER.  THE  MODELS  CAN  BE  USED 
AS  AN  ALTERNATIVE  TO  EXPERIMENTATION  FOR  THE  EVALUATION  OF 
VARIOUS  ALGORITHMS  AND  DIFFERENT  DEGREES  OF  PARALLELISM. 

THEY  CAN  ALSO  BE  USED  TO  STUDY  THE  TRADEOFFS  INVOLVED  IN 
INCREASING  THE  AMOUNT  OF  PARALLEL  COMPUTATION  AT  THE  EXPENSE 
OF  INCREASED  OVERHEAD  FOR  SYNCHRONIZA-  TION  AND 
COMMUNICATION.  THE  DETECTION  AND  ALLEVIATION  OF  PERFORMANCE 
BOTTLENECKS  IS  FACILITATED. 

KEYWORDS: 
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ABSTRACT: 

FLOW  BALANCE  AND  HOMOGENEITY  ASSUMPTIONS  ARE  NEEDED  TO 
DERIVE  OPERATIONAL  COUNTERPARTS  OF  M/M/1  QUEUE  LENGTH  AND 
RESPONSE  TIME  FORMULAS.  THIS  PAPER  PRESENTS  RELATIONSHIPS 
BETWEEN  THE  ASSUMPTION  ERRORS  AND  THE  ERRORS  IN  THE  QUEUE 
LENGTH  AND  RESPONSE  TIME  ESTIMATES.  A SIMPLER  SET  OF 
ASSUMPTION  ERROR  MEASURES  IS  USED  TO  DERIVE  BOUNDS  ON  THE 
ERROR  IN  THE  RESPONSE  TIME  ESTIMATE.  AN  EMPIRICAL  STUDY 
COMPARES  ACTUAL  ERRORS  WITH  THEIR  BOUNDS. 
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SYSTEMS 
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ABSTRACT: 

THERE  ARE  TWO  BASIC  REPRESENTATIONS  OF  WORKLOAD  POPULATIONS* 
IN  LOAD  INDEPENDENT,  SEPARABLE  QUEUEING  NETWORK  MODELS. 

THESE  CORRESPOND  TO  THE  NOTIONS  OF  OPEN  AND  CLOSE  CLASSES, 

AN  OPEN  CLASS  BEING  ONE  IN  WHICH  CUSTOMERS  MAY  ARRIVE  AND 
DEPART  THE  MODEL,  AND  A CLOSE  CLASS  BEING  ONE  IN  WHICH  THE 
NUMBER  OF  CUSTOMERS  IS  FIXED.  THIS  PAPER  EXAMINES  THE 
EFFECTS  ON  MEAN  SYSTEM  PERFORMANCE  MEASURES  OF  THE  WORKLOAD 
REPRESENTATION  CHOSEN.  OPEN  AND  CLOSED  REPRESENTATIONS  ARE 
COMPARED  UNDER  THE  EQUIVALENCY  CONS-  TRAINTS  THAT  THEY 
RESULT  IN  IDENTICAL  SYSTEM  THROUGHPUT  OR  MEAN  SYSTEM 
POPULATION  LEVEL  FOR  THE  CLASS  BEING  CONSIDERED.  IT  IS  SHOWN 
FORMALLY  FOR  A LIMITED  CLASS  OF  NETWORKS  THAT  THE  OPEN 
REPRESENTATION  RESULTS  IN  LARGER  SYSTEM  RESPONSE  TIMES  THAN 
EQUIVALENT  CLOSED  REPRESENTATIONS,  AND  THAT  ONE  OF  THE 
CLOSED  REPRESENTATIONS  RESULTS  IN  THE  SMALLEST  SYSTEM 
RESPONSE  TIME  OF  THOSE  CONSIDERED.  EXTENSIVE  NUMERICAL 
RESULTS  SHOW  FOR  A MORE  GENERAL  CLASS  OF  MODELS  THAT  THERE 
IS  A STRICT  ORDERING  (IN  TERMS  OF  SYSTEM  RESPONSE  TIME)  OF 
THE  NATURAL  CLASS  REPRESENTATIONS  CONSIDERED.  THESE  RESULTS 
CAN  BE  USED  IN  AT  LEAST  TWO  WAYS.  ONE  IS  TO  GUIDE  THE 
INITIAL  REPRESENTATION  OF  COMPUTER  SYSTEM  WORKLOADS  IN 
PERFORMANCE  MODELS.  THE  OTHER  APPLICATION  IS  AS  A COMPONENT 
OF  APPROXIMATE  ANALYSIS  TECHNIQUES  FOR  QUEUEING  MODELS  THAT 
DECOMPOSE  INDIVIDUAL  NETWORKS  INTO  MULTIPLE  SUBMODELS,  EACH 
OF  WHICH  IS  THEN  SOLVED  IN  ISOLATION.  HERE  THE  GOAL  IS  TO 
REPRESENT  CUSTOMER  CLASSES  IN  EACH  SUBMODEL  IN  A WAY  THAT  IS 
CONVENIENT  COMPUTA-  TIONALLY,  AND  THAT  RESULTS  IN 
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PERFORMANCE  MEASURES  CLOSELY  MATCHING  THOSE  OBSERVED  IN  THE 
FULL  NETWORK.  IT  IS  THIS  LATTER  APPLICATION  THAT  WE  ASSUME 
IN  THIS  PAPER.  AN  EXAMPLE  OF  THE  APPLICATION  OF  OUR  RESULTS 
TO  AN  EXISTING  APPROXIMATION  TECHNIQUE  IS  GIVEN. 
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IN  THIS  PAPER  WE  DERIVE  A FORMULA  FOR  THE  MOMENTS  OF  THE 
RESIDUAL  LIFE  IN  OPERATIONAL  CONTEXT,  AND  SHOW  THAT  THE 
PARADOX  OF  RESIDUAL  LIFE  HOLDS  ALSO  IN  A FINITE  QUEUEING 
MODEL.  IN  ADDITION,  WE  PROVE  THE  RENEWAL  THEOREM,  SHOW  THAT 
FORWARD  AND  BACKWARD  TIMES  ARE  INDEPENDENT,  AND  STATE  THE 
MEMORYLESS  PROPERTY.  AS  APPLICATIONS  WE  POINT  OUT  HOW  TO 
DERIVE  TAKACS  RECURRENCE  FORMULA  FOR  THE  MOMENTS  OF  THE 
WAITING  TIME  AND  HOW  TO  BASE  THE  MARKOVIAN  STATE  THEORY  ON 
THIS. 
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ABSTRACT: 

PREDICTING  IMPORTANT  PERFORMANCE  PARAMETERS  OF  COMPUTER 
NETWORKS,  RECOGNIZ-  ING  POTENTIAL  BOTTLENECKS,  COMPARING 
DESIGN  ALTERNATIVES  ARE  FACTORS  OF  DECISIVE  IMPORTANCE  IN 
BUILDING  COMPLEX  COMPUTER  NETWORKS.  IN  THIS  RESPECT, 

COMPUTER  AIDED  SIMULATION  HAS  PROVED  TO  BE  A VERY  EFFECTIVE 
DESIGN  TOOL  IN  A NUMBER  OF  PRACTICAL  APPLICATIONS.  IT  IS 
SHOWN  BY  THE  EXAMPLE  OF  THE  MOSAIC  MODELING  SYSTEM  HOW  A 
SIMULATOR  APPLICABLE  ON  A BROAD  BASIS  COULD  BE  ADAPTED  TO 
THE  SPECIFIC  CHARACTERISTICS  OF  A CLASS  OF  EXISTING  COMPUTER 
NETWORKS.  THE  CLASS  OF  COMPUTER  NETWORKS  CHOSEN  FOR  MODELING 
IS  BASED  ON  DECNET  COMMUNICATION  SOFTWARE.  MODELING 
CONCENTRATES  MAINLY  ON  THE  DECNET  PROTOCOLS  AND  THEIR 
HIERARCHIES.  THE  PAPER  INDICATES  THE  ADAPTATIONS  NECESSARY 
TO  ADJUST  THE  MOSAIC  KERNEL  SYSTEM  ADEQUATELY  TO  DECNET 
COMPUTER  NETWORKS  AND  SUMMARIZES  THE  RESULTS  OF  A RATHER 
EXTENSIVE  VALIDATION  FOR  THE  MODELING  SYSTEM,  COMPRISING 
CALIBRATION  AND  ACCURACY  ESTABLISHMENT,  WHICH  HAS  BEEN 
CARRIED  OUT  SUCCESSFULLY. 
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ABSTRACT: 

IN  THIS  PAPER  WE  PRESENT  A MATHEMATICAL  MODEL  TO  COMPUTE  THE 
BANDWIDTH  OF  THE  MULTIPLE  BUS  INTERCONNECTION  NETWORK.  DUE 
TO  THE  COMPUTATIONAL  COMPLEXITY  ASSOCIATED  WITH  THE  EXACT 
SOLUTION,  THE  PROCESSORS  ARE  REMOVED  FROM  THE  QUEUES  AT  THE 
END  OF  EACH  MEMORY  CYCLE  TO  FACILITATE  THE  ANALY-  SIS.  THIS 
LEADS  TO  APPROXIMATE  SOLUTIONS  WHICH  ARE  BOTH  EASIER  TO 
OBTAIN  AND  VERY  ACCURATE. 
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THE  CHAPTER  OF  THIS  PANEL  WAS  TO  EXAMINE  THE  EVOLUTION  OF 
TECHNOLOGY  AS  IT  AFFECTS  DATA  BASE  MANAGEMENT  SYSTEMS 
(DBMS).  IN  PARTICULAR,  THE  PANEL  MEMBERS  WERE  INSTRUCTED  TO 
EXAMINE  THE  TECHNICAL  AREAS  DISCUSSED  HEREIN  AND  TO  PREPARE 
RECOMMENDATIONS  ON  HOW  THE  MANAGER  OF  A COMPUTER  INSTALL- 
ATION SHOULD  REACT  CONCERNING  THE  DEVELOPMENT  OF  DATA  BASE 
SYSTEMS  OVER  THE  NEXT  FIVE  YEARS.  IN  ADDITION,  THE  PANEL 
EXAMINED  THE  DIRECTIONS  OF  TECHNOLOGICAL  EVOLUTION  OVER  THE 
NEXT  TEN  YEARS  AND  SUMMARIZED  THE  WORK  TO  BE  UNDERTAKEN  TO 
ACHIEVE  REASONABLE  PROGRESS.  THIS  PANEL  INCLUDED  MEMBERS 
FROM  THE  USER  COMMUNITY,  ACADEMIA,  CODASYL,  MANUFACTURERS  OF 
COMPUTER  EQUIPMENT  AND  INDUSTRIAL  FIRMS.  THIS  SPECTURM 
PROVIDED  A BROAD  VIEW  OF  THE  OVERALL  DIRECTIONS  WE  EXPECT 
DATA  BASE  MANAGEMENT  SYSTEMS  TO  TAKE.  FOUR  CATEGORIES  OF 
TOPICS  WERE  DISCUSSED.  THEY  ARE:  (l)  USABILITY  WHICH 
INCLUDES  DATA  BASE  SPECIFICATION,  USE  OF  PROGRAMMING  AIDS, 

DATA  BASE  TUNING,  AVAILABILITY  OF  DATA  BASES,  ERROR  RECOVERY 
AND  DATA  INDEPENDENCE;  (2)  DATA  BASE  ARCHITECTURE  AND 
DISTRIBUTED  DATA  BASE  SYSTEMS;  (3)  NEW  FUNCTIONS  WHICH 
INCLUDE  DATA  BASE  MODELS,  RELATIONAL  INFERENCES,  NATURAL 
LANGUAGES  AND  DATA  BASE  SEMANTICS;  AND  (4)  MISCELLANEOUS 
WHICH  COVERS  STANDARDIZATION  AND  RESEARCH  FINANCING. 
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DATABASE  * PROGRAMMING  AIDS  * DBMS  * DATABASE  ARCHITECTURE  * 
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MANY  AUTHORS  HAVE  SUGGESTED  THAT  OVERALL  PERFORMANCE  OF  A 
DOCUMENT  RETRIEVAL  SYSTEM  IS  IMPROVED  BY  RELEVANCE  FEEDBACK. 
RELEVANCE  FEEDBACK  DENOTES  THE  LAST  THREE  STEPS  IN  THE 
FOLLOWING  PROCESS:  (l)  THE  SEARCHER  ENTERS  A QUERY  (2)  THE 
SYSTEM  PREPARES  A RANKED  LIST  OF  SUGGESTED  DOCUMENTS,  (3) 

THE  SEARCHER  JUDGES  SOME  OF  THE  DOCUMENTS  FOR  RELEVANCY,  (4) 
THE  SEARCHER  INFORMS  THE  SYSTEM  OF  THESE  DOCUMENTS  JUDGED 
AND  OF  THE  JUDGMENT,  (5)  THE  SYSTEM  CONSTRUCTS  A NEW  QUERY 
BASED  ON  THE  DESCRIPTORS  USED  IN  THE  ORIGINAL  QUERY  AND  THE 
DESCRIPTORS  USED  IN  THE  DOCUMENTS  JUDGED,  (6)  THE  SYSTEM 
PREPARES  A SECOND  RANKED  LIST  OF  SUGGESTED  DOCUMENTS.  THE 
PRESUMPTION  IS  THAT  THE  SECOND  LIST  IS  BETTER  THAN  THE 
FIRST.  BY  ALL  PERFORMANCE  MEASURES  (E.G.  "FLUID  RANKING”  AND 
"FROZEN  RANKING”),  THE  SECOND  LIST  IS  BETTER  THAN  THE  FIRST. 
HOWEVER,  IF  ONE  RERANKS  DOCUMENTS  IN  THE  ORIGINAL  LIST  SO  AS 
TO  REFLECT  THE  SEARCHER’S  EFFORTS  (STEP  3),  THE 

CORRESPONDING  PERFORMANCE  MEASURES  ARE  COMPARABLE  TO  THOSE 
FOR  THE  SECOND  LIST.  THE  MARGINAL  DIFFERENCE  BETWEEN  THE 
PER-  FORMANCE  MEASURES  FOR  THE  "RERANKED  ORIGINAL”  LIST 
(SEARCHER’S  EFFORTS  ALONE)  AND  THE  SECOND  LIST  (WHICH 
INCLUDES  COMPUTER  EFFORTS)  MAKES  IT  UNCLEAR  IF  THE  COST  OF 
STEP  4 THROUGH  6 ABOVE  CAN  BE  JUSTIFIED.  IT  IS  HOPED  THAT 
ADVOCATES  OF  RELEVANCE  FEEDBACK  WILL  PRESENT  "RERANKED 
ORIGINAL”  PERFORMANCE  MEASURES  AS  A BASIS  FOR  ANY 
PERFORMANCE  IMPROVEMENT  CLAIMS.  THIS  PAPER  ALSO  PRESENTS 
THREE  REASONABLE,  EASILY  UNDERSTOOD  RETRIEVAL  PROCEDURES  FOR 
WHICH  THE  FROZEN  RANKING,  THE  FLUID  RANKING,  AND  THE 
RERANKED  ORIGINAL  EVALUATIONS  ARE  "OBVIOUSLY”  THE  PERTINENT 
WAY  TO  EVALUATE.  RELEVANCE  FEEDBACK  TECHNIQUES  AS 
IMPLEMENTED  IN  SALTON’S  SMART  DRS  APPEAR  TO  SHOW  THAT  IT  IS 
WORTHWHILE  FOR  USER’S  TO  READ  ABSTRACTS  PRIOR  TO  EVALUATION 
OF  FULL  TEXTS.  THE  LAST  INDICATION  PRESENTED  IN  THIS  PAPER 
IS  THAT  THE  RELEVANCE  FEEDBACK  PERFORMANCE  IMPROVEMENTS 
NOTED  USING  SMART  ARE  DUE  MOSTLY  TO  THE  USER  MAKING 
ASSESSMENTS;  SUBSEQUENT  COMPUTER  EFFORTS  APPEAR  TO  BE  MOST 
LIKELY  TO  RESULT  IN  NO  FURTHER  CHANGE.  FOR  A QUERY  FOR  WHICH 
THERE  IS  A SUBSEQUENT  CHANGE,  THE  CHANGE  IS  AS  LIKELY  TO  BE 
HARMFUL  AS  HELPFUL. 
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ABSTRACT: 

ONE  OF  THE  CENTRAL  PROBLEMS  CONNECTED  WITH  MEASURING  IN 
INFORMATION  RETRIEVAL  IS  THE  PROBLEM  TO  SELECT  ONE  OF 
NUMEROUS  MEASURES  PROPOSED  FOR  EVALUATING  PERFORMANCE  OF 
INFORMATION  RETRIEVAL  SYSTEMS.  IN  ORDER  TO  SEI.ECT  A MEASURE 
WE  HAVE  TO  KNOW  ITS  PROPERTIES  AND  WE  HAVE  TO  BE  ABLE  TO 
COMPARE  IT  WITH  OTHER  MEASURES.  THIS  IN  TURN  BRINGS  US  TO 
THE  NECESSITY  TO  DESCRIBE  MEASURES  IN  SOME  PRECISE  AND 
OPERATIONAL  WAY.  MEASURES  APPLIED  TO  EVALUATE  SYSTEMS  ARE  IN 
FACT  DIRECTLY  APPLICABLE  NOT  TO  SYSTEMS  BUT  RATHER  TO  THEIR 
OUTPUTS.  HENCE  PROPERTIES  OF  SOME  MEASURE  ARE  ALWAYS 
PROPERTIES  EXHIBITED  IN  MEASURING  SETS  OF  RETRIEVAL  OUTPUTS 
AND  DEPEND  ON  HOW  THESE  SETS  ARE  SELECTED.  THE  FOLLOWING  TWO 
APPROACHES  ARE  POSSIBLE  HERE:  WITH  THE  FIRST  ONE  WE  DO  NOT 
LIMIT  THE  RETRIEVAL  OUTPUTS  WHEN  APPLYING  THE  MEASURE. 

WITHIN  THE  SECOND  APPROACH  ONLY  THOSE  RETRIEVAL  OUTPUTS  ARE 
PERMITTED  WHICH  FULFIL  SPECIFIC  RESTRICTING  REQUIREMENTS.  IN 
THIS  PAPER  WE  APPROACH  THE  PROBLEM  OF  HOW  PROPERTIES  AND 
MUTUAL  RELATIONS  OF  PERFORMANCE  MEASURES  ARE  AFFECTED  BY 
REPLACING  THE  UNRESTRICTED  MEASUREMENT  APPROACH  BY  A 
RESTRICTED  ONE.  WE  ESTABLISH  A MATHEMATICAL  MODEL  DESCRIBING 
THE  COMPARABILITY  OF  RETRIEVAL  OUTPUTS.  WE  MAKE  THE 
ASSUMPTION  THAT  COMPARABILITY  IS  REFLEXIVE,  SYMMETRIC  AND 
TRANSITIVE.  THUS  COMPARABILITY  DEFINES  AN  EQUIVALENCE 
RELATION  ON  THE  SET  OF  ALL  RETRIEVAL  OUTPUTS.  THESE 
EQUIVALENCE  RELATIONS  DESCRIBE  UNAMBIGOUSLY  THE 
CORRESPONDING  EVALUATION  RESTRICTIONS.  THE  FOLLOWING 
SPECIFIC  RESTRICTIONS  ARE  INVESTIGATED:  (l)  ONLY  RETRIEVAL 
OUTPUTS  HAVING  THE  SAME  GENERALITY  ARE  COMPARABLE.  (2)  ONLY 
RETRIEVAL  OUTPUTS  HAVING  BOTH  THE  SAME  NUMBER  OF  RELEVANT  AS 
WELL  AS  THE  SAME  NUMBER  OF  NON-RELEV  ANT  DOCUMENTS  ARE 
COMPARABLE,  (3)  ONLY  RETRIEVAL  OUTPUTS  HAVING  BOTH  THE  SAME 
NUMBER  OF  RELEVANT  AS  WELL  AS  THE  SAME  NUMBER  OF 
NON-RELEV  ANT  DOCUMENTS  AND  IN  ADDITION  HAVING  THE  SAME 
NUMBER  OF  DOCUMENTS  IN  EACH  RANK  ARE  COMPARABLE.  IT  IS  SHOWN 
THAT  RESTRICTING  THE  COMPARABILITY  DEFINES  A HOMOMORPHISM  ON 
THE  MEASURES  WITH  RESPECT  TO  THEIR  HIERARCHY.  FINALLY  THE 
SO-CALLED  MICRO-  EVALUATION  IS  DESCRIBED  AND  ANALYZED  FROM 


- 117  - 


THE  VIEW  POINT  OF  RESTRICTED  EVALUATION. 
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ABSTRACT: 

THE  GENERAL  MODEL  AND  SIMULATION  ALGORITHMS  FOR 
BIBLIOGRAPHIC  RETRIEVAL  SYSTEMS  PRESENTED  IN  AN  EARLIER 
PAPER  ARE  EXPANDED.  THE  NEW  MODEL  INTEGRATES  THE  PHYSICAL  AS 
WELL  AS  THE  LOGICAL  AND  SEMANTIC  ELEMENTS  OF  THESE  SYSTEMS. 

A MODIFIED  ALGORITHM  IS  DEVELOPED  FOR  THE  SIMULATION  OF  USER 
RELEVANCE  JUDGMENT,  AND  IS  VALIDATED,  BY  MEANS  OF 
RECALL-PRECISION  CURVES  AND  A KOLMOGOROV-SMIRNOV  TEST  OF 
RECALL,  FOR  TWO  TEST  COLLECTIONS.  OTHER  APPROACHES  TO 
GOODNESS-OF-FIT  TESTING  ARE  SUGGESTED. 
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ABSTRACT: 

A SIMPLE  CONTENT-ANALYSIS  PROGRAM  INCORPORATED  IN  A 
WORD  PROCESSING  SYSTEM  CAN  DISPLAY  THE  MOST  SIGNIFICANT 
SENTENCE  OF  A PAGE  OF  TEXT  AND  GIVE  A SHORT  LIST  OF  THE  MORE 
IMPORTANT  WORDS.  THIS  COULD  HELP  AUTHORS  WRITE  TITLES, 
SUMMARIES,  AND  DESCRIPTOR  LISTS.  THE  CONTENT-ANALYSIS 
PROGRAM  RELIES  ON  WORD  FREQUENCY,  PRECEEDENCE,  AND 
CO-OCCURRENCE  AS  INDICATORS  OF  CONTENT  SIGNIFICANCE.  TEST 
SHOW  IT  PERFORMS  AT  LEAST  AS  WELL  AS  SOME  TRAINED  INDEXERS. 
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INSTITUT  FUR  SOFTWARE  - TECHNOLOGIE,  GESELLSCHAFT  FUR 
MATHEMATIK  UNO  DATENVERARBEITUNG,  GERMANY 

ABSTRACT; 

A SELF-TUNING  ADAPTIVE  INFORMATION  RETRIEVAL  SYSTEM  AS  AN 
EXTENSION  OF  THE  CONCEPT  OF  A "CLASSICAL”  DOCUMENT  RETRIEVAL 
SYSTEM,  IS  OUTLINED.  THIS  SYSTEM  ACCEPTS  DOCUMENTS  AND 
SEARCH  REQUESTS  IN  NATURAL  LANGUAGE,  AS  WELL  AS  THE 
SYSTEM-PROPOSALS  PREVIOUSLY  PRODUCED  BY  THE  SYSTEM  ITSELF  OR 
PRE-  PARED  BY  THE  SYSTEM  OPERATOR.  IT  PRODUCES  A 
SYSTEM-PROPOSAL  THAT  CONSISTS  OF  A LIST  OF  DOCUMENTS  RANKED 
ACCORDING  TO  THEIR  RELEVANCE  TO  THE  QUERY.  INCORPORATED  INTO 
THE  SYSTEM  IS  A SYSTEM  VALUATION  SUBSYSTEM  THAT  USES 
WEIGHTED  RELEVANCE  JUDGMENTS.  THIS  SUBSYSTEM  GIVES  AS  OUTPUT 
AN  EFFECTIVE-  NESS  VALUE  AND  AN  EFFICIENCY  VALUE;  BOTH 
TOGETHER  MEASURE  THE  QUALITY  OF  AN  INFORMATION  RETRIEVAL 
SYSTEM.  THE  COMPUTATION  OF  THE  QUALITY  VALUES  AND  THE  VALUES 
THEMSELVES  ARE  INDEPENDENT  OF  A SPECIFIC  IMPLEMENTATION.  THE 
RETRIE-  VAL  PROCESS  IN  THIS  SYSTEM  CONSISTS  OF  TWO  PARTS, 
NAMELY  A QUERY-DOCUMENT  MATCH  AND  A QUERY-QUERY  MATCH. 
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MODELS  ARE  DEVELOPED  FOR  THE  PRIMARY  SITE  AND  THE  PRIMARY 
COPY  LOCKING  SCHEMES  FOR  CONCURRENCY  CONTROL  IN  DISTRIBUTED 
DATABASES.  THESE  MODELS  ARE  THEN  ANALYZES  TO  OBTAIN  ANALYTIC 
RESULTS,  WHICH  ENABLE  ONE  TO  CONVENIENTLY  MAKE  COMPARISONS 
OF  TWO  LOCKING  SCHEMES  IN  TERMS  OF  THEIR  PROCESSING  TIMES 
FOR  UPDATE  REQUESTS  AS  WELL  AS  OTHER  DESIGN  DECISIONS.  THE 
ANALYSIS  FOLLOWS  AN  APPROACH  BASED  ON  A SYSTEMATIC 
ASSIGNMENT  OF  COMPARABLE  VALUES  TO  CORRESPONDING  PARAMETERS 
IN  THE  TWO  MODELS. 
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ONE  COMPONENT  OF  THE  LITERATURE  ON  MODEL  MANAGEMENT  IN 
DECISION  SUPPORT  SYSTEMS  (DSSs)  SUGGESTS  THAT  THE  RELATIONAL 
FRAMEWORK  FOR  DATA  MANAGEMENT  BE  EXTENDED  TO  THE  MANAGEMENT 
OF  DECISION  MODELS.  THE  AUTHOR  EXAMINES  THESE  IMPORTANT 
DESIGN  ISSUES  IN  RELATIONAL  MODEL  MANAGEMENT,  THE  ORGANIZA- 
TION OF  RELATIONAL  MODEL  BANKS,  RELATIONAL  COMPLETENESS  OF 
MODEL  QUERY  LAN-  GUAGES,  AND  SYSTEM  IMPLEMENTATIONS. 
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COiMMERCIAL  DATABASE  ENVIRONMENT  IN  RECENT  YEARS.  IT  IS  NOW 
FINDING  ITS  WAY  INTO  THE  DESIGN  AUTOMATION  (CAD/CAM)  AREA. 

THE  AUTHOR  EXPLAINS  WHAT  THE  RELATIONAL  DATA  MODEL  IS  AND 
HOW  DATABASE  MANAGEMENT  SYSTEMS  BASED  ON  IT  CAN  BE  USED  WITH 
DESIGN  AUTOMATION  APPLICATIONS. 
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THE  USE  OF  A DIFFERENTIAL  FILE  FOR  A DATABASE  UPDATE  CAN 
YIELD  INTEGRITY  AND  PERFORMANCE  BENEFITS,  BUT  IT  CAN  ALSO 
PRESENT  PROBLEMS  IN  PROVIDING  CURRENT  DATA  TO  SUBSEQUENT 
ACCESSING  TRANSACTIONS.  A MECHANISM  KNOWN  AS  BLOOM  FILTER 
CAN  SOLVE  THESE  PROBLEMS  BY  PREVENTING  MOST  UNNECESSARY 
SEARCHES  OF  THE  DIFFERENTIAL  FILE.  THE  DESIGN  PROCESS  FOR  AN 
ONLINE  STUDENT  DATABASE  IS  DESCRIBED,  AND  IS  SHOWN  THAT  A 
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HIERARCHICAL  DATA-BASE  MANAGEMENT  SYSTEMS  (DBMS).  THE 
RESULTS  OBTAINED  CAN  BE  FUTHER  APPLIED  TO  CHOOSE  STOR-  AGE 
STRUCTURES  AND  DB  ALLOCATION  TO  COMPUTER  STORAGE  DEVICES. 
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TITLE: 

ASSOCIATIVE  SEARCH  TECHNIQUES  VERSUS  PROBABILISTIC  RETRIEVAL 
MODELS 

AUTHOR(s): 

MARON  M.  E. 

AFFILIATION: 

UNIVERSITY  OF  CALIFORNIA 
ABSTRACT: 

THIS  ARTICLE  OFFERS  A PERSONAL  LOOK  BACK  AT  THE  ORIGINS  AND 
EARLY  USE  OF  ASSOCIATIVE  SEARCH  TECHNIQUES  AND  ALSO  LOOK 
TOWARD  AT  MORE  THEORETICAL  APPROACHES  TO  THE  DOCUMENT 
RETRIEVAL  PROBLEMS.  THE  PURPOSE  IS  TO  CONTRAST  THE  FOLLOWING 
TWO  WAYS  OF  IMPROVING  SYSTEMS  PERFORMANCE:(l)  APPENDING 
ASSOCIATIVE  SEARCH  TECHNIQUES  TO  LESS  OR  MORE  STANDARD 
(CONVENTIONAL)  DOCUMENT  RETRIEVAL  SYSTEMS,  AND  (2)DESIGNING 
DOCUMENT  RETRIEVAL  SYSTEMS  BASED  ON  MORE  FUNDAMENTAL  AND 
APPROPRIATE  PRINCIPLES  NAMELY  PROBABILISTIC  DESIGN  PRIN- 
CIPLES. VERY  RECENT  WORK  ON  PROBABILISTIC  APPROACHES  TO  THE 
DOCUMENT  RETRIEVAL  PROBLEM  HAS  PROVIDED  A NEW  AND  RARE 
UNIFICATION  OF  TWO  PREVIOUSLY  COMPETING  MODELS.  IN  LIGHT  OF 
THIS,  THE  AUTHORS  ARGUE  THAT  IF  ONE  HAD  TO  CHOOSE  THE  BEST  . 
WAY  TO  IMPROVE  PERFORMANCE  OF  A DOCUMENT  RETRIEVAL  SYSTEM, 
IT  WOULD  BE  WISER  TO  IMPLEMENT,  TEST  AND  EVALUATE  THIS  NEW 
UNIFIED  MODEL,  RATHER  THAN  TO  CONTINUE  TO  USE  ASSOCIATIVE 
TECHNIQUES  WHICH  ARE  COUPLED  TO  CONVENTIONALLY  DESIGNED 
RETRIEVAL  SYSTEMS. 
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THIS  IS  THE  FIRST  OF  TWO  ARTICLES  THAT  REPORT  ON  THE 
DEVELOPMENT,  TESTING,  AND  EVALUATION  OF  THE  INDIVIDUALIZED 
INSTRUCTION  FOR  DATA  ACCESS  SYSTEMS  (IIDA).  IDDA  IS  AN 
EXAMPLE  OF  A CLASS  OF  COMPUTER  SYSTEMS  WHICH  SERVE  AS 
INTERMEDIARIES,  ENABLING  THEIR  USERS  TO  PERFORM  A COMPLEX 
TASK  ON  ANOTHER  COMPUTER  , AND  WHICH  ARE  COMING  TO  BE  KNOWN 
AS  EXPERT  SYSTEMS.  THE  SYSTEM  WAS  DESIGNED  TO  ENCOURAGE  END 
USERS  OF  INFORMATION  RETRIEVAL  SYSTEMS  TO  PERFORM  THEIR  OWN 
SEARCHES  BY  (l)  INSTRUCTING  THEM  IN  HOW  TO  SEARCH,  USING 
COMPUTER-ASSISTED  INSTRUCTION  AND  (2)  ASSISTING  WITH  THE 
PERFORMANCE  OF  THE  SEARCH  BY  PROVIDING  DIAGNOSTIC  ANALYSES 
OF  THE  USERS’  PERFORMANCE  AS  WELL  AS  ANSWERING  THEIR 
QUESTIONS  ABOUT  HOW  TO  USE  SYSTEM  COMMANDS.  THE  SYSTEM’S 
DESIGN  IS  DESCRIBED,  AS  WELL  AS  THE  VARIOUS  TEST  OF  ITS 
PERFORMANCE  AND  THE  EVALUATION  OF  TEST  RESULTS.  THE 
CONCLUSION  IS  DRAWN  THAT  END  USERS  CAN  BECOME  SUCCESSFUL 
SEARCHES  THROUGH  SUCH  AN  ASSISTANT,  FOR  THE  KINDS  OF 
SEARCHES  TESTED. 
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LANGUAGE  AND  INFORMATION  RETRIEVAL  IN  SOCIAL  SCIENCES 

AUTHOR(s): 
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ABSTRACT: 

DISCUSSES  WAYS  IN  WHICH  SOCIAL  SCIENTISTS  USE  LANGUAGE,  IN 
BOTH  NATURAL  AND  TECHNICAL  FORMS,  AND  DESCRIBES  SOME  OF  THE 
RESULTANT  COMMUNICATION  PROBLEMS  THAT  RELATE  TO  THE 
DEVELOPMENT  OF  INFORMATION  SERVICES.  IT  IS  IMPORTANT  THAT 
SUCH  DEVICES  SHOULD  BE  MATCHED  TO  THE  STRUCTURE  OF  KNOWLEDGE 
WITHIN  THE  RELEVANT  DISCIPLINES  SO  THAT  THEY  CAN  CONTRIBUTE 
EFFECTIVELY  TO  CREATION  OF  NEW  KNOWLEDGE.  IN  ORDER  FOR  THIS 
TO  BE  ACHIEVED,  SERVICE  PROVIDERS  MUST  UNDER-  STAND  THE 
LANGUAGE  OF  THEIR  USERS. 
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JOURNAL: 
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TITLE: 

HUMAN  FACTORS  AND  BEHAVIORAL  SCIENCE:  STATISTICAL  SEMANTICS: 
ANALYSIS  OF  THE  POTENTIAL  PERFORMANCE  OF  KEY-WORD 
INFORMATION  SYSTEMS 

AUTHOR(s): 

FURNAS,  C.  W. 

AFFILIATION: 

BELL  LABORATORY 

ABSTRACT: 

THIS  PAPER  EXAMINES  HOW  IMPRECISION  IN  THE  WAY  HUMANS  NAME 
THINGS  MIGHT  LIMIT  HOW  WELL  A COMPUTER  CAN  GUESS  TO  WHAT 
THEY  ARE  REFERENCING.  PEOPLE  WERE  ASKED  TO  NAME  THINGS  IN  A 
VARIETY  OF  DOMAINS  : INSTRUCTIONS  FOR  TEXT  EDITING 
OPERATIONS,  INDEX  WORDS  FOR  COOKING  RECIPES,  CATEGORIES  FOR 
’WANT  ADS’  AND  DESCRIPTIONS  OF  COMMON  OBJECTS.  IT  WAS  FOUND 
THAT  RANDOM  PAIRS  OF  PEOPLE  USED  THE  SAME  WORD  FOR  AN  OBJECT 
ONLY  10  TO  20  PERCENT  OF  THE  TIME.  BUT  IT  WAS  ALSO  FOUND 
THAT  HIT  RATES  COULD  BE  INCREASED  THREEFOLD  BY  USING  NORMS 
ON  NAMING  TO  PICK  OPTIMALS  NAMES  BY  RECOGNIZING  AS  MANY  OF 
THE  USERS’  VARIOUS  WORDS  AS  POSSIBLE  AND  BY  ALLOWING  THE 
USER  AND  THE  SYSTEM  SEVERAL  GUESSES  IN  TRYING  TO  HIT  UPON 
THE  DESIRED  TARGET. 
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MANY  WHO  ARE  LONGTIME  MEDLINE  SEARCHES  HAVE  NOW  BRANCHED  OUT 
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INTO  OTHER  NON-NATIONAL  LIBRARY  OF  MEDICINE  (NLM)  DATABASES. 
THEY  ARE  SEARCHING  THE  BUSINESS  DATABASES  FOR  HOSPITAL 
ADMINISTRATORS,  THE  CHEMISTRY  AND  BIOLOGY  FILES  FOR 
BIOCHEMISTS,  AND  THE  SOCIAL  SCIENCE  DATABASES  FOR  NURSES, 
STUDENTS,  AND  LIBRARY  DIRECTORS.  THE  AUTHOR  EXPLORES  SOME  OF 
THESE,  UTILIZING  COMPARISONS  OF  THE  THESAURI  OF  THE 
MEDELINE,  ERIC,  AND  PSY-INFO  DATABASES. 
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TITLE: 
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ABSTRACT: 

THIS  ARTICLE  DESCRIBES  THE  STRUCTURE  AND  FORMAT  OF  THE 
COURSES,  THE  BACKGROUND  AND  INTEREST  OF  THE  PARTICIPANTS  AND 
THE  OVERALL  COURSE  GOALS.  THE  RELATIVE  SUCCESS  OF  THE 
COURSES  AS  DETERMINED  BY  SEVERAL  FACTORS  (INCLUDING  THE 
NUMBER  OF  END  USERS  WHO  HAVE  CONTINUED  SEARCHING  SINCE  THE 
END  OF  THE  TRAINING  IS  DISCUSSED  WITHIN  THE  FRAMEWORK  OF 
MAKING  TRAINING  COURSES  MORE  EFFECTIVE  FOR  END  USERS.  THE 
ARTICLE  CONCLUDES  WITH  A GENERAL  DISCUSSION  OF  END 
SEARCHING.  THE  DISCUSSION  DEALS  PARTICULARLY  WITH  THE 
PROBLEM  OF  THE  END  USER  MAINTAINING  COMPETENCE  WHILE 
SEARCHING  IN  A CASUAL  BASIS. 
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TITLE: 

THEORETICAL  ASPECTS  OF  RELATIONAL  DATA  BASE  DESIGN 
AUTHOR(s): 

GORCHINSKAYA,  O.  YU. 

ABSTRACT: 

THE  ARTICLE  CONSIDERS  THEORETICAL  ASPECTS  CONNECTED  WITH  THE 
RELATIONAL  DATA  BASE  MODEL.  SPECIAL  EMPHASIS  IS  ON 
FORMALIZATION  OF  THE  LOGICAL  DESIGN  OF  RELATIONAL  DATA  BASE. 
CERTAIN  KINDS  OF  INTEGRITY  CONSTRAINTS  ARE  CONSIDERED  AS 
WELL  AS  THE  PROBLEM  OF  SCHEMA  EQUIVALENCE,  NORMAL  FORMS  OF 
RELATIONS,  AND  NORMALIZATION  METHODS. 
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DBMS:  LOGICAL  MUST  PRECEDE  PHYSICAL  DESIGN 

AUTHOR(s): 

ORR,  K. 

ABSTRACT: 

PROBLEMS  WITH  DATA  BASE  MANAGEMENT  SYSTEMS  (DBMS)  MAINLY  LIE 
WITH  THE  PERSONNEL  RATHER  THAN  THE  SOFTWARE.  GOOD  DATA  BASE 
DESIGNS  CONSISTS,  FIRST,  OF  UNDERSTANDING  EXACTLY  WHAT  YOU 
WANT  TO  DO  AND  THEN  DETERMINING  THE  BEST  WAY  TO  GET  THE  DATA 
BASE  SOFTWARE  TO  DO  IT.  LOGICAL  DESIGN  IS  MOST  IMPORTANT. 
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AUTHOR(s): 
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AFFILIATION: 
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ABSTRACT: 

THE  AUTHOR  REPORTS  ON  A COMPUTER  MONITORING  STUDY  OF  USERS 
OF  THE  OHIO  STATE  LIBRARIES’  ONLINE  CATALOG,  AND  ESTABLISHED 
AND  HEAVILY  USED  INFORMATION  RETRIEVAL  SYSTEM.  THIS  IS  THE 
FIRST  MONITORING  STUDY  OF  AN  ONLINE  CATALOG  PERFORMED 
WITHOUT  SYSTEM-DEFINED  USER  SESSIONS.  ONLINE  CATALOGS 
REPRESENT  A CLASS  OF  RETRIEVAL  SYSTEMS  WHICH  RE  DESIGNED  FOR 
END  USERS,  REQUIRE  LITTLE  OR  NO  FORMAL  TRAINING,  AND  REPLACE 
AN  EXISTING  FORMAL  SYSTEM.  THE  STUDY  CHARACTERIZES  USERS 
BEHAVIOR  IN  TERMS  OF  TYPE  OF  SEARCHES  DONE,  PATTERNS  OF  USE, 
TYPE  SPENT  ON  SEARCHING  ERRORS,  AND  SYSTEM  PROBLEMS. 
PRELIMINARY  RESULTS  SUGGESTS  THAT  USERS  HAS  MUCH  SHORTER 
SESSIONS  THAN  IN  OTHER  TYPES  OF  RETRIEVAL  SYSTEMS.  PATTERNS 
OF  USE  VARY  BETWEEN  CAMPUS  LIBRARIES,  ACADEMIC  QUARTERS,  AND 
BETWEEN  SHORT  AND  LONG  SESSIONS.  RESULTS  OF  THE  STUDY  WILL 
BE  APPLIED  TO  IMPROVING  THE  USER  INTERFACE  AND  OTHER  SYSTEM 
FEATURES. 
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AFFILIATION: 
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ABSTRACT: 

A NETWORK  ORGANIZATION  FOR  IMPLEMENTING  A DOCUMENT  RETRIEVAL 
SYSTEM  IS  PRO-  POSED.  THIS  ORGANIZATION  HAS  SIGNIFICANT 
ADVANTAGES  IN  TERM  OF  THE  RANGE  OF  SEARCHES  THAT  CAN  BE  USED 
WHEN  COMPARED  TO  EITHER  INVERTED  OR  CLUSTERED  FILES 
ORGANIZATIONS.  ALGORITHMS  FOR  GENERATING  AND  MAINTAINING  THE 
NETWORK  ARE  DESCRIBED  TOGETHER  WITH  EXPERIMENTS  DESIGNED  TO 
TEST  THEIR  EFFICIENCY  AND  EFFECTIVENESS. 
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AUTHOR(s): 
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AFFILIATION: 
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ABSTRACT: 

A PRINCIPLE  OF  INFORMATION  SCIENCE  STATES  THAT  THE  ENTROPY 
OF  A SET  OF  SYMBOLS  IS  MAXIMIZED  WHEN  THE  PROBABILITY  OF 
OCCURRENCE  OF  EACH  BECOMES  THE  SAME.  THIS  PAPER  PRESENTS  THE 
RESULTS  OF  A NUMBER  OF  EXPERIMENTS  WHICH  UTILIZE  THIS 
PRINCIPLE  TO  CONSTRUCT  FIXED  LENGTH  KEYS  FROM  PERTINENT 
FIELDS  IN  ORDER  TO  LOCATE  AND  RETRIEVE  UNIQUE  RECORDS  AS 
WELL  AS  CLUSTERS  WITH  LEXICALLY  HOMOGENEOUS  INFORMATION. 
EACH  KEY  INCORPORATES  CODES  DERIVED  BY  VARIOUS  POSITIONAL 
SELECTION  METHODS  AND  THEIR  DISCRIMINATING  STRENGTH  PROVES 
TO  BE  OVER  95%. 
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A CLUSTERING  ALGORITHM  IS  DESCRIBED.  THE  ALGORITHM  PROPOSED 
DETERMINES  BOTH  THE  NUMBER  OF  CLUSTER  IN  A COLLECTION  AND 
THE  NUMBER  OF  ELEMENTS  IN  EACH  CLUSTER  BEFORE  BEGINNING  THE 
FINAL  CLUSTERING  PROCESS. 
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ABSTRACT: 

THE  NORMALIZED  RECALL  IS  ONE  OF  THE  MOST  POPULAR  EVALUATION 
MEASURES  FOR  INFORMATION  RETRIEVAL  SYSTEMS.  ON  OVERVIEW  OF 
ITS  DEVELOPMENT  IS  GIVEN.  IT  IS  THEN  SHOWN  THAT  THE 
NORMALIZED  RECALL  IS  CLOSELY  RELATED  TO  OTHER  MEASURE  SUCH 
AS  THE  CRE-MEASURE  AND  THE  EXPECTED  SEARCH  LENGTH.  SOME 
IMPLICATIONS  ARE  ANALYZED. 
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ABSTRACT: 

SEARCHES  OF  BIBLIOGRAPHICAL  DATABASES  ARE  FACED  WITH  A 
MULTITUDE  OF  CHOICES,  BUT  VERY  FEW  CLUES,  IN  DEVELOPING 
PRECISE  SEARCH  STRATEGIES.  THIS  STUDY  ATTEMPTS  TO  DISCOVER 
SUBJECT  PATTERNS  AND  CLUSTERS  AMONG  DATABASES  IN  ORDER  TO 
PROVIDE  CLUES  ABOUT  DIFFERENCES  AND  SIMILARITIES  AMONG  THEM. 
DESCRIPTORS  WERE  TAKEN  AT  RANDOM  FROM  SEVEN  SUBJECT 
CATEGORIES  IN  THE  ERIC  THESAURUS  AND  AND  USED  AS  SEARCH 
TERMS  ON  BIBLIOGRAPHIC  RETRIEVAL  SERVICES’  CROSS  DATABASE. 

THE  RESULTING  1830312  POSTING  FROM  54  DATABASES  WERE 
ANALYZED  IN  TWO  WAYS:  (l)  AN  EXPECTATION  RATIO  WAS  COMPUTED 
WHICH  ALLOWED  RANKING  DATABASES  IN  ORDER  OF  THEIR  RELATIVE 
RESPONSES  TO  THE  SUBJECT  SEARCHES;  (2)  A CLUSTER  ANALYSIS  IS 
CONDUCTED  TO  DISCOVER  POSSIBLE  SUBJECT  RELATIONSHIPS  AMONG 
DATABASES.  THE  RESULT  SHOW  FIVE  LARGE  CLUSTERS  : TECHNOLOGY, 
LIFE  SCIENCES,  BIBLIOGRAPHY,  BUSINESS  AND  INDUSTRY,  AND 
EDUCATION;  AND  12  WELL  DEFINED  SUBCLUSTERS.  IT  ALSO  SHOWS 
SEVERAL  DIMENSION  WITH  CUT  ACROSS  CLUSTERS,  SUCH  AS  RESE.ARCH 
AND  SOCIAL  AND  ECONOMIC  ENTERPRISE,  AND  INDICATES  THAT  THERE 
ARE  NON-OBVIOUS  SIMILARITIES  AND  DIFFERENCES  AMONG  DATABASES 
WHICH  MAY  PROVIDE 
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NATURAL  LANGUAGE  PROCESSING  TECHNIQUES  DEVELOPED  FOR 
ARTIFICIAL  INTELLIGENCE  PROGRAMS  CAN  AID  IN  CONSTRUCTING 
POWERFUL  INFORMATION  RETRIEVAL  SYSTEMS  IN  AT  LEAST  TWO 
AREAS.  AUTOMATIC  CONSTRUCTION  OF  NEW  CONCEPTS  ALLOWS  A LARGE 
BODY  OF  INFORMATION  TO  BE  ORGANIZED  COMPACTLY  IN  A MANNER 
THAT  ALLOWS  A WIDE  RANGE  OF  QUERIES  TO  BE  ANSWERED.  ALSO, 
USING  NATURAL  LANGUAGE  PROCESSING  TECHNIQUES  TO  CONCEPTUALLY 
ANALYZE  THE  DOCUMENTS  BEING  STORED  IN  A SYSTEM  GREATLY 
EXPANDS  THE  EFFECTIVENESS  OF  QUERIES  ABOUT  GIVEN  PIECES  OF 
TEXT.  HOWEVER,  ONLY  ROBUST  CONCEPTUAL  ANALYSIS  METHODS  ARE 
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ADEQUATE  FOR  SUCH  SYSTEMS.  THIS  PAPER  DISCUSSES  APPROACHES 
TO  BOTH  CONCEPT  LEARNING,  IN  THE  FORM  OF  GENERALIZED-BASED 
MEMORY  AND,  POWERFUL,  ROBUST  TEXT  PROCESSING  ACHIEVED  BY 
MEMORY-BASED  UNDERSTANDING.  THESE  TECHNIQUES  HAVE  BEEN 
IMPLEMENTED  IN  THE  COMPUTER  SYSTEM  IPP,  A PROGRAM  THAT 
READS,  REMEMBERS  AND  GENERALIZES  FROM  NEW  STORIES  ABOUT 
TERRORISM,  AND  RESEARCHER,  CURRENTLY  IN  THE  PROTOTYPE  STAGE, 
THAT  OPERATES  IN  A VERY  DIFFERENT  DOMAIN  (TECHNICAL  TEXTS, 
PATENT  ABSTRACTS  IN  PARTICULAR). 
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ABSTRACT: 

INFORMATION  RETRIEVAL  (IR)  SYSTEMS  MAY,  IN  GENERAL,  BE 
CONSIDERED  AS  CONSIST-  ING  OF  A USER,  AN  INTERACTIVE 
MECHANISM,  AND  A KNOWLEDGE  RESOURCE  INTEGRATED  ABOUT  THE 
COMMON  GOAL  OF  HELPING  THE  USER  SUCCESSFULLY  TO  MANAGE  THE 
PRO-  BLEM  THAT  HAS  INDUCED  HIM/HER  TO  INITIATE  THE  SYSTEM. 

IN  THESE  TERMS,  WHAT  ARE  CALLED  ’ON-LINE  IR  SYSTEMS’  CAN  BE 
SEEM  AS  AN  INFORMATION  INTERACTION  MECHAN-  ISM  (CONSISTING 
USUALLY  OF  A HUMAN  INTERMEDIARY,  SOME  INTERACTION 
CAPABILITIES  BETWEEN  INTERMEDIARY  AND  DATA  BASE,  A RETRIEVAL 
LANGUAGE  AND  A RETRIEVAL  STRATEGY)  AND  A KNOWLEDGE  RESOURCE 
(MEANING  THE  DATA  BASE  ITSELF).  A MAJOR  GOAL  OF  IR  RESEARCH 
AT  THE  MOMENT  IS  TO  ALLOW  THE  USER  DIRECT  ACCESS  TO  THE  DATA 
BASE  WITHOUT  RECOURSE  TO  THE  HUMAN  INTERMEDIARY.  THE  AUTHOR 
ANALYZE  A NUMBER  OF  DIALOGUES.  THEY  DISCUSS  THE  DESIGN  OF  AN 
IRS,  IS  ONE. 
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DATE:  JUNE  1983 
PAGES:  75  - 80 


TITLE:. 

NATURAL  LANGUAGE  GRAMMARS  FOR  INFORMATION  SYSTEM 

AUTHOR(s): 

DE  SOPENA,  L. 

AFFILIATION: 

UNIVERSITY  DEL  PAIS  VASCO,  SPAIN 
ABSTRACT: 

THE  USER  SPECIALITY  LANGUAGES  (USL)  SYSTEM  IS  AN  APPLICATION 
INDEPENDENT  NATURAL  LANGUAGE  INTERFACE  TO  A RELATIONAL 
DATABASE  SYSTEM.  IT  PROVIDES  NONDP-TRAINED  PEOPLE  WITH  A 
TOOL  TO  INTRODUCE,  QUERY,  MANIPULATE,  AND  ANALYZE  THE  DATA 
STORED  IN  A RELATIONAL  DATABASE  VIA  NATURAL  LANGUAGE.  USL 
INTERFACES  WITH  DIFFERENT  LANGUAGES;  IN  THE  PRESENT  PAPER 
THE  GRAMMAR  DEVELOPED  FOR  SPANISH  IS  PRESENTED,  AND  COMPARED 
WITH  THE  GERMAN  GRAMMAR  WHICH  WAS  PREVIOUSLY  IMPLEMENTED  AND 
UPON  WHICH  IT  IS  BASED.  THEIR  MAIN  DIFFERENCES  ARE  POINT 
OUT,  AND  THE  GENERALITY  OF  THE  SYSFEM  TO  DEAL  WITH  OTHER 

natural  languages  is  shown. 


REFERENCE  CODE:  189 
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PROCEEDINGS  OF  THE  SIXTH  ANNUAL  INTERNATIONAL  ACM  SIGIR 

CONFERENCE  ON  RESEARCH  AND  DEVELOPMENT  IN  INFORMATION 

RETRIEVAL 

DATE:  JUNE  1983 

PAGES:  252  - 263 

TITLE: 

SOME  RESEARCH  PROBLEMS  IN  AUTOMATIC  INFORMATION  RETRIEVAL 

AUTHOR(s): 

SALTON,  G. 

AFFILIATION: 

CORNELL  UNIVERSITY 

ABSTRACT: 

INFORMATION  RETRIEVAL  COMPONENTS  ARE  CURRENTLY  INCORPORATED 
IN  SEVERAL  TYPES  OF  INFORMATION  SYSTEMS,  INCLUDING 
BIBLIOGRAPHIC  RETRIEVAL  SYSTEMS,  DATA  BASE  MANAGEMENT 
SYSTEMS  AND  QUESTION-ANSWERING  SYSTEMS.  SOME  OF  THE  PROBLEMS 
ARISING  IN  THE  REAL  TIME  ENVIRONMENT  IN  WHICH  THESE  SYSTEMS 
OPERATE  ARE  BRIEFLY  DISCUSSED.  CERTAIN  RECENT  ADVANCES  IN 
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INFORMATION  RETRIEVAL  RESEARCH  ARE  THEN  MENTIONED,  INCLUDING 
THE  FORMULATION  OF  NEW  PROBABILISTIC  RETRIEVAL  MODELS,  AND 
THE  DEVELOPMENT  OF  AUTOMATIC  DOCUMENT  ANALYSIS  AND  BOOLEAN 
QUERY  PROCESSING  TECHNIQUES. 
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REFERENCE  CODE:  190 
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THE  ANNUAL  INTERNATIONAL  ACM  SIGIR  CONFERENCE  ON  RESEARCH 
AND  DEVELOPMENT  IN  INFORMATION  RETRIEVAL 
DATE:  JUNE  1983 
PAGES:  264  - 265 

TITLE: 

INFORMATION  RETRIEVAL:  NEW  DIRECTIONS:  OLD  SOLUTIONS 


AUTHOR(s): 

RISJSBERGEN,  C.  J. 

ABSTRACT: 

THE  AUTHOR  EXAMINES  THE  QUESTION  OF  RELEVANCE  OF  RETRIEVAL 
DOCUMENTS.  HE  LOOKS  AT  THREE  TYPES  OF  QUERIES  AND  HOW  THESE 
AFFECTS  IRS  DESIGN.  HE  FORSEES  AN  INTEGRATION  BETWEEN  DBMS, 

IR  AND  EXPERT  SYSTEMS. 
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ASLIB  PROCEEDINGS 
VOLUME:  35 

ISSUE:  9 

DATE:  SEPTEMBER  1983 
PAGES:  346  - 353 

TITLE: 

EXTERNAL  DATABASES:  AN  OVERVIEW 

AUTHOR(s): 

FOSTER,  A. 

ABSTRACT: 

A TOPOLOGY  FOR  EXTERNAL  ONLINE  DATABASES  IS  PRESENTED  AND 
THE  CURRENT  NUMBER  OF  BIBLIOGRAPHIC  AND  SOURCE  DATABASES  IS 
ACCESSED.  THE  NATURE  AND  IMPORTANCE  OF  SOURCE  DATABASES, 
PARTICULARLY  FULL  TEXT  AND  NUMERIC  SERVICES,  IS  DISCUSSED. 
INFORMATION  PROFESSIONALS  MUST  EMBRACE  THESE  NEW  PRODUCTS  IF 
THEY  ARE  TO  MAINTAIN  AND  EXTEND  THEIR  ROLE  IN  INFORMATION 
TRANSFER. 
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TITLE: 

PROGRESS  TOWARD  DATABASE  MANAGEMENT  STANDARDS 

AUTHOR(s): 

DEUTSCH,  D.  R. 

AFFILIATION: 

GENERAL  ELECTRIC  INFORxMATION  SERVICES 
ABSTRACT: 

THE  FIRST  PROPOSAL  FOR  DATABASE  MANAGEMENT  STANDARDS 
APPEARED  IN  THE  LATE  1960S.  WORK  BEGAN  ON  A US  NATIONAL 
STANDARD  IN  1978.  TODAY  THERE  ARE  NO  DOMESTIC  OR 
INTERNATIONAL  DATAB.^SE  MANAGEMENT  STANDARDS  ALTHOUGH 
ORGANIZA-  TIONS  THROUGHOUT  THE  WORD  ARE  WORKING  TOWARD  THIS 
GOAL.  THIS  PAPER  DESCRIBES  THESE  VARIOUS  ORGANIZATIONS  AND 
THE  STATUS  OF  THEIR  WORK.  IT  OUTLINES  RECENT  CHANGES  IN  THE 
STRUCTURE  AND  SCOPE  OF  THE  AMERICAN  DATABASE  MANAGEMENT 
STANDARDIZATION  ACTIVITIES  THAT  HAVE  SUBSTANTIALLY  IMPROVED 
THE  OUTLOOKS  FOR  TIMELY  RESULTS. 
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TITLE: 

COST-EFFECTIVE  WAYS  OF  IMPROVING  DATABASE  COMPUTER 
PERFORMANCE 

AUTHOR(s): 

HSIAO,  D.  K. 

AFFILIATION: 

NAVAL  POSTGRADUATE  SCHOOL 
ABSTRACT: 

IN  THIS  PAPER  THE  HARDWARE  FEATURES  THAT  CHARACTERIZE  THE 
PERFORMANCE  BOT-  TLENECK  OF  CONVENTIONAL  DATABASE  COMPUTERS 
ARE  IDENTIFIED.  MOTIVATIONS  FOR  AND  PROPOSAL  OF  NEW 
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ARCHITECTURES  FOR  OVERCOMING  THE  BOTTLENECKS  FOR  FUTURE 
DATABASE  COMPUTERS  ARE  GIVEN. 
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20TH  ANNUAL  MEETING  OF  THE  ASSOCIATION  FOR  COMPUTATIONAL 

LINGUISTICS 

DATE:  JUNE  1982 

PAGES:  44  - 45 

TITLE: 

NATURAL  LANGUAGE  ACCESS  TO  DATABASES  - THEORETICAL/TECHNICAL 
ISSUES 

AUTHOR(s): 

MOORE,  R.  C. 

AFFILIATION: 

ARTIFICIAL  INTELLIGENCE  CENTER.  SRI  INTERNAT 
ABSTRACT: 

ALTHOUGH  THERE  HAVE  BEEN  MANY  EXPERIMENTAL  SYSTEMS  FOR 
NATURAL-LANGUAGE  ACCESS  TO  DATABASES  WITH  SOME  hlOW  GOING 
INTO  ACTUAL  USE,  MANY  PROBLEMS  IN  THE  AREA  REMAIN  TO  BE 
SOLVED.  THE  AUTHOR  PRESENTS  DESCRIPTIONS  OF  FIVE  PROB-  LEM 
AREAS  THAT  SEEM  TO  ME  NOT  TO  BE  ADEQUATELY  HANDLED  BY  ANY 
EXISTING  SYSTEM. 
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PAGES:  563  - 573 

TITLE: 

THE  LOGICAL  ACCESS  PATH  SCHEMA  OF  A DATABASE 

AUTHOR(s): 

ROUSSOPOULOS,  N. 

AFFILIATION: 

UNIVERSITY  OF  MARYLAND 
ABSTRACT: 

A SCHEMA  WHICH  MODELS  THE  USAGE  OF  THE  LOGICAL  ACCESS  PATHS 
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OF  THE  DATABASE  IS  PROPOSED.  THE  SCHEMA  MODELS  OF  DATABASE 
ACTIVITIES  (I.E.  RETRIEVALS,  AND  UPDATES),  AND  INTEGRATES 
THEIR  LOGICAL  ACCESS  PATHS  BY  RECOGNIZING  COMMON  SUBPATHS 
AND  INCREASING  THE  ’WEIGHT’  OF  THE  SHARED  SUBPATHS.  THE 
LOGICAL  ACCESS  PATH  SCHEMA  PROVIDES  A COMPREHENSIVE  PICTURE 
OF  THE  LOGICAL  ACCESS  PATHS,  AND  THE  CUMULATIVE  USAGE  OF  THE 
SHARED  SUBPATHS  AND/OR  INTERMEDIATE  RESULTS.  THE  SCHEMA 
SERVES  A DUAL  PURPOSE.  FIRSTLY,  IT  IS  USED  AS  A MODEL  OF  THE 
ACCESS  REQUIREMENTS  DURING  THE  DATABASE  DESIGN,  AND 
SECONDLY,  AS  THE  BASIS  FOR  OPTIMIZATION  DURING  THE  OPERATION 
OF  THE  DATABASE. 
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REFERENCE  CODE:  196 

JOURNAL: 

IEEE  TRANSACTION  SOFTWARE  ENGINEERING 

VOLUME:  8 

ISSUE:  6 

DATE:  NOVEMBER  1982 

PAGES:  611  - 619 

TITLE: 

ANALYSIS  OF  EXTENDIBLE  HASHING 

AUTHOR(s): 

MENDELSON,  H. 

AFFILIATION: 

UNIVERSITY  OF  ROCHESTER 
ABSTRACT: 

EXTENDIBLE  HASHING  IS  AN  ATTRACTIVE  DIRECT-ACCESS  TECHNIQUE 
WHICH  HAS  BEEN  INTRODUCED  RECENTLY.  IT  IS  CHARACTERIZED  BY  A 
COMBINATION  OF  DATABASE-SIZE  FLEXIBILITY  AND  FAST  DIRECT 
ACCESS.  THIS  PAPER  DERIVES  PERFORMANCE  MEASURES  FOR 
EXTENDIBLE  HASHING,  AND  CONSIDERS  THEIR  IMPLICATIONS  ON  THE 
PHYSICAL  DATABASE  DESIGN.  A COMPLETE  CHARACTERIZATION  OF  THE 
PROBABILITY  DISTRIBUTION  OF  THE  DIRECTORY  SIZE  AND  DEPTH  IS 
DERIVED,  AND  ITS  IMPLICATIONS  ON  THE  DESIGN  OF  THE  DIRECTORY 
ARE  STUDIED.  THE  EXPECTED  INPUT/OUTPUT  COSTS  OF  VARIOUS 
OPERATIONS  ARE  DERIVED,  AND  THE  EFFECTS  OF  VARYING  PHYSICAL 
DESIGN  PARAMETERS  ON  THE  EXPECTED  AVERAGE  OPERATING  COST  AND 
ON  THE  EXPECTED  VOLUME  ARE  STUDIED. 


****»**»****«»«*«*****»»»**»*s****«s****«»**«»»****«»**«********« 


- 139  - 


ATTACHMENT  6.9 


USL  DBMS  PME  BIBLIOGRAPHIC 


SUPPORT  DATA  BASE  STATUS 


USL 


NASA . PME  MADAM 


DATA 


BASE  STATUS 


Logical  data  base  name 

Physical  data  base  path  name 

Date  Inversion 

Text  Inversi on 

Standard  Stopword  List 

User  S t o pwo  r d List 

User  Keyword  List 

Coinnent  s File 

Bulletin  File 

The  saurus  File 

Ma  c r o File 

Textual  Description 

Public/Private  File- 

Data  Base  Administrator 

Number  of  Records 

Creation  Date 

Latest  Update 


NASA.  PME 

> udd  >DBMS  >NASA/R&D 

yes 

yes 

yes 

no 

no 

no 

no 

no 

no 


no 

pub  1 i c 
TangKS  .DES4S 
53 

08/01/84 

08/01/84 


NASA.PME  OUTPUT  (08/01/84.  2223.17) 
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A STRAIGHTFORWARD  MODEL  FOR  COMPUTER  PERFORMANCE  PREDICTION 
AUTHOR(s): 

BOYSE,  JOHN  W.  * WARN,  DAVID  R. 

AFFILIATION: 

RESEARCH  LABORATORIES,  GENERAL  MOTORS  CORPORATION,  WARREN 
ABSTRACT: 

BOTH  SIMULATION  AND  ANALYTIC  MODELS  OF  COMPUTER  SYSTEMS  CAN 
BE  VERY  USEFUL  FOR  PREDICTING  THE  PERFORMANCE  OF  PROPOSED 
NEW  SYSTEMS  OR  PROPOSED  CHANGES  TO  EXISTING  SYSTEMS. 
UNFORTUNATELY,  MANY  POTENTIAL  USERS  OF  MODELS  ARE  RELUCTANT 
TO  USE  THEM  BECAUSE  OF  THE  COMPLEXITY  OF  MANY  SUCH  MODELS 
AND  THE  DIFFICULTY  OF  RELATING  THE  MODEL  TO  THE  REAL  SYSTEM. 
THIS  TUTORIAL  PAPER  LEADS  THE  READER  THROUGH  THE  DEVELOPMENT 
AND  USE  OF  AN  EASILY  UNDERSTOOD  ANALYTIC  MODEL.  THIS  IS  THEN 
PLACED  IN  CONTEXT  WITH  A CLASS  OF  SIMILAR  ANALYTIC  MODELS. 

IN  SPITE  OF  THE  SIMPLICITY  (UTILIZATION,  THROUGHPUT,  AND 
RESPONSE)  USING  ONLY  THE  MOST  BASIC  SYSTEM  DATA  AS  INPUT. 

THESE  PARAMETERS  CAN  EITHER  BE  ESTIMATES  OR  MEASUREMENTS 
FROM  A RUNNING  SYSTEM.  THE  MODEL  EQUATIONS  AND  ASSUMPTIONS 
ARE  DEFINED,  AND  A DETAILED  CASE  STUDY  IS  PRESENTED  AS  AN 
EXAMPLE  OF  THEIR  USE. 

KEYWORDS: 

COMPUTER  PERFORMANCE  PREDICTION  * ANALYTIC  MODELS  • QUEUEING 
* SIMULATION. 

CATEGORIES: 
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ISSUE:  1 
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PAGES:  3-18 

TITLE: 

A REVIEW  AND  EVALUATION  OF  SOFTWARE  SCIENCE 
AUTHOR(s): 

FITZSIMMONS,  ANN  • LOVE,  TOM 
AFFILIATION: 

GENERAL  ELECTRIC  COMPANY 
ABSTRACT: 

DURING  RECENT  YEARS,  THERE  HAVE  BEEN  MANY  ATTEMPTS  TO  DEFINE 
AND  MEASURE  THE  "COMPLEXITY”  OF  A COMPUTER  PROGRAM.  MAURICE 
HALSTEAD  HAS  DEVELOPED  A THEORY  THAT  GIVES  OBJECTIVE 
MEASUREMENTS  OF  SOFTWARE  COMPLEXITY.  VARIOUS  STUDIES  AND 
EXPERIMENTS  HAVE  SHOWN  THAT  THE  THEORY’S  PREDICTIONS  OF  THE 
NUMBER  OF  BUGS  IN  PROGRAMS  AND  OF  THE  TIME  REQUIRED  TO 
IMPLEMENT  A PROGRAM  ARE  AMAZINGLY  ACCURATE.  IT  IS  A 
PROMISING  THEORY  WORTHY  OF  MUCH  MORE  PROBING  SCIENTIFIC 
INVESTIGATION.  THIS  PAPER  REVIEWS  THE  THEORY,  CALLED 
"SOFTWARE  SCIENCE”,  AND  THE  EVIDENCE  SUPPORTING  IT.  A BRIEF 
DESCRIPTION  OF  A RELATED  THEORY,  CALLED  "SOFTWARE  PHYSICS”, 

IS  INCLUDED. 

KEYWORDS: 

SOFTWARE  RELIABILITY  * SOFTWARE  ENGINEERING  * SOFTWARE 
MANAGEMENT  * COGNITIVE  PSYCHOLOGY  * SOFTWARE  MEASUREMENT  * 
SOFTWARE  COMPLEXITY 

CATEGORIES: 

4.0  » 4.6 
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COST-BENEFIT  ANALYSIS  IN  INFORMATION  SYSTEMS  DEVELOPMENT  AND 
OPERATION 

AUTHOR(s): 

KING,  JOHN  LESLIE  * SCHREMS,  EDWARD  L. 

AFFILIATION: 

THE  URBIS  GROUP,  PUBLIC  RESEARCH  ORGANIZATION,  UNIVERSITY  OF 
CALIFORNIA,  IRVINE,  CALIFORNIA 

ABSTRACT: 

COST-BENEFIT  ANALYSIS  OF  COMPUTER-BASED  INFORMATION  SYSTEMS 
IS  A MAJOR  CONCERN  OF  MANAGERS  IN  PUBLIC  AND  PRIVATE 
ORGANIZATIONS  USING  COMPUTERS.  THIS  PAPER  INTRODUCES  AND 
REVIEWS  BASIC  ELEMENTS  OF  COST-BENEFIT  ANALYSIS  AS  APPLIED 
TO  COMPUTERIZED  INFORMATION  SYSTEMS,  AND  PROVIDES  DISCUSSION 
OF  THE  MAJOR  PROBLEMS  TO  BE  AVOIDED. 

KEYWORDS: 

COST-BENEFIT  ANALYSIS  * MANAGEMENT  OF  COMPUTING  * EVALUATING 
CATEGORIES: 
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COMPUTER  SYSTEMS 
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ROSE,  CLIFFORD  A. 

AFFILIATION: 

NAVAL  ELECTRONIC  SYSTEMS  COMMAND,  WASHINGTON,  D.C.  20360 
ABSTRACT: 

THIS  TUTORIAL  PAPER  DESCRIBES  A PROCEDURE  FOR  OBTAINING 
INPUT  PARAMETER  VALUES  AND  OUTPUT  PERFORMANCE  MEASURES  FOR  A 
POPULAR  CLASS  OF  QUEUEING  NETWORK  MODELS.  THE  PROCEDURE 
MAKES  USE  OF  CURRENT  MEASUREMENT  MONITORS  AS  MUCH  AS 
POSSIBLE.  WE  SURVEY  THE  TWO  BASIC  APPROACHES  TO  MONITORING 
(HARDWARE,  SOFTWARE,  AND  HYBRID).  ALSO  SURVEYED  ARE 
MEASUREMENT  TOOLS  FOR  THE  ANALYTICAL  MODELING  OF  SEVERAL 
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CURRENT  FAMILIES  OF  COMPUTER  SYSTEMS.  WE  DISCUSS  IN  DETAIL 
EXAMPLES  OF  MODEL  VALIDATION  AND  PERFORMANCE  PREDICTIONS  TO 
ILLUSTRATE  THE  MEASUREMENT  PROCEDURES  AND  THE  CLASS  OF 
MODELS. 

KEYWORDS: 

QUEUEING  NETWORK  MODELS  * ANALYTICAL  MODELS  » MODEL 
VALIDATIONS  ♦ PERFORMANCE  EVALUATION  * MEASUREMENTS  * 
MONITORS 
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AFFILIATION: 

INSTITUTE  FOR  COMPUTER  SCIENCES  AND  TECHNOLOGY.  NATIONAL 
BUREAU  OF  STANDARDS  * BGS  SYSTEMS.  INC. 

ABSTRACT: 

DATABASE  REORGANIZATION  CAN  BE  DEFINED  AS  CHANGING  SOME 
ASPECT  OF  THE  WAY  IN  WHICH  A DATABASE  IS  ARRANGED  LOGICALLY 
AND/OR  PHYSICALLY.  AN  EXAMPLE  IS  CHANGING  FROM  A ONE-TO-ONE 
TO  A ONE-TO-MANY  RELATIONSHIP.  REORGANIZATION  IS  A NECESSARY 
FUNCTION  IN  A DATABASE  SYSTEM.  THIS  PAPER  INTRODUCES  THE 
BASIC  CONCEPTS  OF  REORGANIZATION.  INCLUDING  WHY  IT  IS 
PERFORMED.  MANY  TYPES  OF  REORGANIZATION  ARE  DESCRIBED  AND 
CLASSIFIED  INTO  LOGICAL/PHYSICAL  LEVELS.  THEN  PRAGMATIC 
ISSUES  SUCH  AS  REORGANIZATION  STRATEGIES.  A SURVEY  OF 
SEVERAL  COMMERCIAL  REORGANIZATION  FACILITIES,  CASE  STUDIES, 
AND  DATABASE  ADMINISTRATION  CONSIDERATIONS  ARE  COVERED. 
FINALLY,  SEVERAL  RESEARCH  EFFORTS  ARE  SURVEYED. 

KEYWORDS: 

DATABASE  * DATABASE  MANAGEMENT  » REORGANIZATION  * 
RESTRUCTURING  * FILE  MAINTENANCE 
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ABSTRACT: 

THE  CONCEPT  OF  AN  INTEGRATED  DICTIONARY/DIRECTORY  (D/D) 

SYSTEM  IS  DISCUSSED  IN  DETAIL,  AND  THE  STATE  OF  CURRENT 
SYSTEMS  IN  BOTH  THE  CENTRALIZED  AND  DISTRIBUTED  DATABASE 
ENVIRONMENTS  IS  SURVEYED.  FOR  THE  CENTRALIZED  DATABASE 
ENVIRONMENT,  THREE  ASPECTS  ARE  EMPHASIZED:  (l)  THE  SOFTWARE 
INTERFACES  BETWEEN  THE  D/D  SYSTEM  AND  OTHER  SOFTWARE 
PACKAGES,  (2)  THE  CONVERT  FUNCTION  OF  THE  D/D  SYSTEM,  AND 
(3)  THE  ENVIRONMENTAL  DEPENDENCY  BETWEEN  THE  D/D  SYSTEM  AND 
A DATABASE  MANAGEMENT  SYSTEM  (DBMS).  FOR  THE  DISTRIBUTED 
DATABASE  ENVIRONMENT,  THE  ARTICLE  ELUCIDATES  THE  NECESSARY 
EXTENSIONS  TO  THE  CENTRALIZED  D/D,  THE  ADDITIONAL  SOFTWARE 
INTERFACES  REQUIRED,  AND  THE  USE  OF  THE  D/D  AS  A DISTRIBUTED 
DATABASE.  AN  EXAMPLE  OF  A COMMERCIAL  D/D  SYSTEM  THAT  IS 
INTEGRATED  WITH  A DISTRIBUTED  DBMS  IS  PRESENTED. 
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ABSTRACT: 

THE  OPTIMAL  DISTRIBUTION  OF  FILES  AMONG  STORAGE  NODES  IS  A 
MAJOR  PROBLEM  IN  COMPUTER  SYSTEM  OPTIMIZATION.  DIFFERING 
DESIGN  GOALS,  VARYING  SYSTEM  ASSUMPTIONS,  AND  CONTRASTING 
SOLUTION  TECHNIQUES  YIELD  A DISPARITY  OF  OPTIMAL  FILE 
ASSIGNMENTS.  THIS  PAPER  VIEWS  THE  DIFFERING  FILE  ASSIGNMENT 
MODELS  IN  A UNIFORM  MANNER.  RELATIVE  ADVANTAGES  AND 
WEAKNESSES  OF  THE  VARIOUS  MODELS  BECOME  IMMEDIATELY 
APPARENT.  THIS  PERSPECTIVE  EXPOSES  THE  FURTHER  RESEARCH 
WHICH  IS  NECESSARY  IN  ORDER  TO  PROVIDE  A TRULY  SATISFACTORY 
SOLUTION  TO  THE  FILE  ASSIGNMENT  PROBLEM. 
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CAN  YIELD  SUBSTANTIAL  EFFICIENCIES  IN  THE  OPERATING  COST  OF 
DATABASE  SYSTEMS.  HOWEVER,  SINCE  THE  NUMBER  OF  POSSIBLE 
PHYSICAL  RECORD  STRUCTURES  FOR  DATABASE  OF  PRACTICAL 
SIGNIFICANCE  IS  ENORMOUS,  AND  THEIR  EVALUATION  IS  EXTREMELY 
COMPLEX  DETERMINING  EFFICIENT  RECORD  STRUCTURES  BY  FULL 
ENUMERATION  IS  GENERALLY  INFEASIBLE.  THIS  PAPER  DISCUSSES 
THE  TECHNIQUES  OF  MATHEMATICAL  CLUSTERING,  ITERATIVE 
GROUPING  REFINEMENT,  MATHEMATICAL  PROGRAMMING,  AND, 
HIERARCHIC  AGGREGATION,  WHICH  CAN  BE  USED  TO  QUICKLY 
DETERMINE  EFFICIENT  RECORD  STRUCTURES  FOR  LARGE,  SHARED 
DATABASES. 

KEYWORDS: 
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ABSTRACT: 

THE  PROBLEMS  OF  FILE  ALLOCATION  AND  CAPACITY  ASSIGNMENT  IN  A 
FIXED  TOPOLOGY  DISTRIBUTED  COMPUTER  NETWORK  ARE  EXAMINED. 
THESE  TWO  ASPECTS  OF  THE  DESIGN  ARE  TIGHTLY  COUPLED  BY  MEANS 
OF  AN  AVERAGE  MESSAGE  DELAY  CONSTRAINT.  THE  OBJECTIVE  IS  TO 
ALLOCATE  COPIES  OF  INFORMATION  FILES  TO  NETWORK  NODES  AND 
CAPACITIES  TO  NETWORK  LINKS  SO  THAT  A MINIMUM  COST  IS 
ACHIEVED  SUBJECT  TO  NETWORK  DELAY  AND  FILE  AVAILABILITY 
CONSTRAINTS.  A MODEL  FOR  SOLVING  THE  PROBLEM  IS  FORMULATED 
AND  THE  RESULTING  OPTIMIZATION  PROBLEM  IS  SHOWN  TO  FALL  INTO 
A CLASS  OF  NONLINEAR  INTEGER  PROGRAMMING  PROBLEMS. 
DETERMINISTIC  TECHNIQUES  FOR  SOLVING  THIS  CLASS  OF  PROBLEMS 
ARE  COMPUTATIONALLY  CUMBERSOME,  EVEN  FOR  SMALL  SIZE 
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PROBLEMS.  A NEW  HEURISTIC  ALGORITHM  IS  DEVELOPED,  WHICH  IS 
BASED  ON  A DECOMPOSITION  TECHNIQUE  THAT  GREATLY  REDUCES  THE 
COMPUTATIONAL  COMPLEXITY  OF  THE  PROBLEM.  NUMERICAL  RESULTS 
FOR  A VARIETY  OF  NETWORK  CONFIGURATIONS  INDICATE  THAT  THE 
HEURISTIC  ALGORITHM,  WHILE  NOT  THEORETICALLY  CONVERGENT, 
YIELDS  PRACTICABLE  LOW  COST  SOLUTIONS  WITH  SUBSTANTIAL 
SAVINGS  IN  COMPUTER  PROCESSING  TIME  AND  STORAGE 
REQUIREMENTS.  MOREOVER,  IT  IS  SHOWN  THAT  THIS  ALGORITHM  IS 
CAPABLE  OF  SOLVING  REALISTIC  NETWORK  PROBLEMS  WHOSE 
SOLUTIONS  USING  DETERMINISTIC  TECHNIQUES  ARE  COMPUTATIONALLY 
INTRACTABLE. 
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BUFFER  SPACE  IS  CREATED  AND  MANAGED  IN  DATABASE  SYSTEMS  IN 
ORDER  TO  REDUCE  ACCESSES  TO  THE  I/O  DEVICES  FOR  DATABASE 
INFORMATION.  IN  SYSTEMS  USING  VIRTUAL  MEMORY  ANY  INCREASE  IN 
THE  BUFFER  SPACE  MAY  BE  ACCOMPANIED  BY  AN  INCREASE  IN 
PAGING.  THE  EFFECTS  OF  THESE  FACTORS  ON  SYSTEM  PERFORMANCE 
ARE  QUANTIFIED  WHERE  SYSTEM  PERFORMANCE  IS  A FUNCTION  OF 
PAGE  FAULTS  AND  DATABASE  ACCESSES  TO  I/O  DEVICES.  THIS 
PHENOMENON  IS  EXAMINED  THROUGH  THE  ANALYSIS  OF  EMPIRICAL 
DATA  GATHERED  IN  A MULTIFACTOR  EXPERIMENT.  THE  FACTORS 
CONSIDERED  ARE  MEMORY  SIZE,  SIZE  OF  BUFFER  SPACE,  MEMORY 
REPLACEMENT  ALGORITHM.  THE  IMPROVEMENT  OF  SYSTEM  PERFORMANCE 
THROUGH  AN  INCREASE  IN  THE  SIZE  OF  THE  BUFFER  SPACE  IS 
DEMONSTRATED.  IT  IS  ALSO  SHOWN  THAT  FOR  CERTAIN  VALUES  OF 
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THE  OTHER  FACTORS  AN  INCREASE  IN  THE  SIZE  OF  THE  BUFFER 
SPACE  CAN  CAUSE  PERFORMANCE  TO  DETERIORATE. 
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ABSTRACT: 

THE  EMERGENCE  OF  A DATABASE  TECHNOLOGY  IN  RECENT  YEARS  HAS 
FOCUSED  INTEREST  ON  THE  SUBJECT  OF  DATA  MODELS.  A DATA  MODEL 
IS  THE  CLASS  OF  LOGICAL  DATA  STRUCTURES  WHICH  A COMPUTER 
SYSTEM  OR  LANGUAGE  MAKES  AVAILABLE  TO  THE  USER  FOR  THE 
PURPOSE  OF  FORMULATING  DATA  PROCESSING  APPLICATIONS.  THE 
DIVERSITY  OF  COMPUTER  SYSTEMS  AND  LANGUAGES  HAS  RESULTED  IN 
A CORRESPONDING  DIVERSITY  OF  DATA  MODELS,  AND  HAS  CREATED  A 
PROBLEM  FOR  THE  USER  IN  SELECTING  A DATA  MODEL  WHICH  IS  IN 
SOME  SENSE  APPROPRIATE  TO  A GIVEN  APPLICATION.  AN  EVALUATION 
PROCEDURE  IS  NEEDED  WHICH  WILL  ALLOW  THE  USER  TO  EVALUATE 
ALTERNATIVE  MODELS  IN  THE  CONTEXT  OF  A SPECIFIC  SET  OF 
APPLICATIONS.  THIS  PAPER  TAKES  A FIRST  STEP  TOWARD  SUCH  A 
PROCEDURE  BY  IDENTIFYING  THE  ATTRIBUTES  OF  A DATA  MODEL 
WHICH  CAN  BE  USED  AS  CRITERIA  FOR  EVALUATION  THE  MODEL.  TWO 
KINDS  OF  CRITERIA  ARE  PRESENTED:  USE  CRITERIA,  WHICH  MEASURE 
THE  USABILITY  OF  THE  MODEL;  AND  IMPLEMENTATION  CRITERIA, 

WHICH  MEASURE  THE  IMPLEMENTABILITY  OF  THE  MODEL  AND  THE 
EFFICIENCY  OF  THE  RESULTING  IMPLEMENTATION.  THE  USE  OF  THE 
CRITERIA  IS  ILLUSTRATED  BY  APPLYING  THEM  TO  THREE  SPECIFIC 
MODELS:  AN  N-ARY  RELATIONAL  MODEL,  A HIERARCHIC  MODEL,  AND  A 
NETWORK  MODEL. 


- 10  - 


KEYWORDS: 

DATA  MODEL  * DATA  MODEL  EVALUATION  * DATA  MODEL  SELECTION  » 
RELATIONAL  MODEL  * HIERARCHIC  MODEL  * NETWORK  MODEL 

CATEGORIES: 

4.20  * 4.33  » 4.34 

*******************************tt**************t********x******** 


REFERENCE  CODE:  12 

JOURNAL: 

TODS 

VOLUME:  2 

ISSUE:  1 

DATE:  MARCH  1977 
PAGES:  45  - 67 

TITLE: 

AN  ATTRIBUTE  BASED  MODEL  FOR  DATABASE  ACCESS  COST  ANALYSIS 

AUTHOR(s): 

YAO,  S.  B. 

AFFILIATION: 

PURDUE  UNIVERSITY 

ABSTRACT: 

A GENERALIZED  MODEL  FOR  PHYSICAL  DATABASE  ORGANIZATIONS  IS 
PRESENTED.  EXISTING  DATABASE  ORGANIZATIONS  ARE  SHOWN  TO  FIT 
EASILY  INTO  THE  MODEL  AS  SPECIAL  CASES.  GENERALIZED  ACCESS 
ALGORITHMS  AND  COST  EQUATIONS  ASSOCIATED  WITH  THE  MODEL  ARE 
DEVELOPED  AND  ANALYZED.  THE  MODEL  PROVIDES  A GENERAL  DESIGN 
FRAMEWORK  IN  WHICH  THE  DISTINGUISHING  PROPERTIES  OF  DATABASE 
ORGANIZATIONS  ARE  MADE  EXPLICIT  AND  THEIR  PERFORMANCES  CAN 
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ABSTRACT: 

SECONDARY  INDEXES  ARE  OFTEN  USED  IN  DATABASE  MANAGEMENT 
SYSTEMS  FOR  SECONDARY  KEY  RETRIEVAL.  ALTHOUGH  THEIR  USE  CAN 
IMPROVE  RETRIEVAL  TIME  SIGNIFICANTLY,  THE  COST  OF  INDEX 
MAINTENANCE  AND  STORAGE  INCREASES  THE  OVERHEAD  OF  THE  FILE 
PROCESSING  APPLICATION.  THE  OPTIMAL  SET  OF  INDEXED  SECONDARY 
KEYS  FOR  A PARTICULAR  APPLICATION  DEPENDS  ON  A NUMBER  OF 
APPLICATION  DEPENDENT  FACTORS.  IN  THIS  PAPER  A COST  FUNCTION 
IS  DEVELOPED  FOR  THE  EVALUATION  OF  CANDIDATE  INDEXING 
CHOICES  AND  APPLIED  TO  THE  OPTIMIZATION  OF  INDEX  SELECTION. 
FACTORS  ACCOUNTED  FOR  INCLUDE  FILE  SIZE,  THE  RELATIVE  RATES 
OF  RETRIEVAL  AND  MAINTENANCE  OVER  THE  CANDIDATE  KEYS,  INDEX 
STRUCTURE,  AND  SYSTEM  CHARGING  RATES.  AMONG  THE  RESULT 
DEMONSTRATED  ARE  THE  INCREASED  EFFECTIVENESS  OF  SECONDARY 
INDEXES  FOR  LARGE  FILE,  THE  EFFECT  OF  THE  RELATIVE  RATES  OF 
RELATIVE  RATES  OF  RETRIEVAL  AND  MAINTENANCE  THE  GREATER  COST 
OF  ALLOWING  FOR  ARBITRARILY  FORMULATED  QUERIES,  AND  THE 
IMPACT  ON  COST  OF  THE  USE  OF  DIFFERENT  INDEX  STRUCTURES. 
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AN  ASSOCIATIVE  PROCESSOR  CALLED  RAP  HAS  BEEN  DESIGNED  TO 
PROVIDE  HARDWARE  SUPPORT  FOR  THE  USE  AND  MANIPULATION  OF 
DATABASES.  RAP  IS  PARTICULARLY  SUITED  FOR  SUPPORTING 
RELATIONAL  DATABASES.  IN  THIS  PAPER,  THE  RELATIONAL 
OPERATIONS  PROVIDED  BY  THE  RAP  HARDWARE  ARE  DESCRIBED,  AND  A 
REPRESENTATIVE  APPROACH  TO  PROVIDING  THE  SAME  RELATIONAL 
OPERATIONS  WITH  CONVENTIONAL  SOFTWARE  AND  HARDWARE  IS 
DEVISED.  ANALYTIC  MODELS  ARE  CONSTRUCTED  FOR  RAP  AND  THE 
CONVENTIONAL  SYSTEM.  THE  EXECUTION  TIMES  OF  SEVERAL  OF  THE 
OPERATIONS  ARE  SHOWN  TO  BE  VASTLY  IMPROVED  WITH  RAP  FOR 
LARGE  RELATIONS. 
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BUFFER  POOLS  ARE  CREATED  AND  MANAGED  IN  DATABASE  SYSTEMS  IN 
ORDER  TO  REDUCE  THE  TOTAL  NUMBER  OF  ACCESSES  TO  THE  I/O 
DEVICES.  IN  SYSTEMS  USING  VIRTUAL  MEMORY,  ANY  REDUCTION  IN 
I/O  ACCESSES  MAY  BE  ACCOMPANIED  BY  AN  INCREASE  IN  PAGING. 

THE  EFFECTS  OF  THESE  FACTORS  ON  SYSTEM  PERFORMANCE  ARE 
QUANTIFIED,  WHERE  SYSTEM  PERFORMANCE  IS  A FUNCTION  OF  PAGE 
FAULTS  AND  DATABASE  ACCESSES  TO  THE  I/O  DEVICES.  A PREVIOUS 
STUDY  OF  THIS  PHENOMENON  IS  EXTENDED  THROUGH  THE  ANALYSIS  OF 
EMPIRICAL  DATA  GATHERED  IN  A MULTIFACTOR  EXPERIMENT.  IN  THIS 
STUDY  MEMORY  IS  PARTITIONED  BETWEEN  THE  PROGRAM  AND  THE 
BUFFER  SO  THAT  THE  IMPACT  OF  THE  CONTROLLED  FACTORS  CAN  BE 
MORE  EFFECTIVELY  EVALUATED.  IT  IS  POSSIBLE  TO  IMPROVE  SYSTEM 
PERFORMANCE  THROUGH  THE  USE  OF  DIFFERENT  PAGING  ALGORITHMS 
IN  THE  PROGRAM  PARTITION  AND  THE  BUFFER  PARTITION.  ALSO,  THE 
EFFECTS  ON  SYSTEM  PERFORMANCE  AS  THE  VIRTUAL  BUFFER  SIZE  IS 
INCREASED  BEYOND  THE  REAL  MEMORY  ALLOCATED  TO  THE  BUFFER 
PARTITION  ARE  INVESTIGATED. 
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AN  INFERENTIAL  RELATIONAL  SYSTEM  IS  ONE  IN  WHICH  DATA  IN  THE 
SYSTEM  CONSISTS  OF  BOTH  EXPLICIT  FACTS  AND  GENERAL  AXIOMS 
(OR  "VIEWS”).  THE  GENERAL  AXIOMS  ARE  USED  TOGETHER  WITH  THE 
EXPLICIT  FACTS  TO  DERIVE  THE  FACTS  THAT  ARE  IMPLICIT 
(VIRTUAL  RELATIONS)  WITHIN  THE  SYSTEM.  A TOP-DOWN  ALGORITHM, 
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AS  USED  IN  ARTIFICIAL  INTELLIGENCE  WORK,  IS  DESCRIBED  TO 
DEVELOP  INFERENCES  WITHIN  THE  SYSTEM.  THE  TOP-DOWN  APPROACH 
STARTS  WITH  THE  QUERY,  A CONJUNCTION  OF  RELATIONS,  TO  BE 
ANSWERED.  EITHER  A RELATIONAL  FACT  SOLVES  A GIVEN  RELATION 
IN  A CONJUNCT,  OR  THE  RELATION  IS  REPLACED  BY  A CONJUNCT  OF 
RELATIONS  WHICH  MUST  BE  SOLVED  TO  SOLVE  THE  GIVEN  RELATION. 
THE  APPROACH  REQUIRES  THAT  ONE  AND  ONLY  ONE  RELATION  IN  A 
CONJUNCTION  BE  REPLACED  (OR  EXPANDED)  BY  THE  GIVEN  FACTS  AND 
GENERAL  AXIOMS.  THE  DECISION  TO  EXPAND  ONLY  A SINGLE 
RELATION  IS  TERMED  A SELECTION  FUNCTION.  IT  IS  SHOWN  FOR 
RELATIONAL  SYSTEMS  THAT  SUCH  A RESTRICTION  STILL  GUARANTEES 
THAT  A SOLUTION  TO  THE  PROBLEM  WILL  BE  FOUND  IF  ONE  EXISTS, 
THE  ALGORITHM  PROVIDES  FOR  HEURISTIC  DIRECTION  IN  THE  SEARCH 
PROCESS.  EXPERIMENTAL  RESULTS  ARE  PRESENTED  WHICH  ILLUSTRATE 
THE  TECHNIQUES.  A BOOKKEEPING  MECHANISM  IS  DESCRIBED  WHICH 
PERMITS  ONE  TO  KNOW  WHEN  SUBPROBLEMS  ARE  SOLVED,  IT  FURTHER 
FACILITATES  THE  OUTPUTTING  OF  REASONS  FOR  THE  DEDUCTIVELY 
FOUND  ANSWER  IN  A COHERENT  FASHION. 
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THE  PROBLEM  OF  FINDING  OPTIMAL  REORGANIZATION  INTERVALS  FOR 
LINEARLY  GROWING  FILES  IS  SOLVED.  AN  APPROXIMATE 
REORGANIZATION  POLICY,  INDEPENDENT  OF  FILE  LIFETIME,  IS 
OBTAINED.  BOTH  THE  OPTIMUM  AND  APPROXIMATE  POLICIES  ARE 
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COMPARED  TO  PREVIOUSLY  PUBLISHED  RESULTS  USING  A NUMERICAL 
EXAMPLE. 
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ABSTRACT: 

CASDAL  IS  A HIGH  LEVEL  DATA  LANGUAGE  DESIGNED  AND 
IMPLEMENTED  FOR  THE  DATABASE  MACHINE  CASSM.  THE  LANGUAGE  IS 
USED  FOR  THE  MANIPULATION  AND  MAINTENANCE  OF  A DATABASE 
USING  AN  UNNORMALIZED  (HIERARCHICALLY  STRUCTURED)  RELATIONAL 
DATA  MODEL.  IT  ALSO  HAS  FACILITIES  TO  DEFINE,  MODIFY,  AND 
MAINTAIN  THE  DATA  MODEL  DEFINITION.  THE  UNIQUENESS  OF  CASDAL 
LIES  IN  ITS  POWER  TO  SPECIFY  COMPLEX  OPERATIONS  IN  TERMS  OF 
SEVERAL  NEW  LANGUAGE  CONSTRUCTS  AND  ITS  CONCEPT  OF  TAGGING 
OR  MARKING  TUPLES  AND  OF  MATCHING  VALUES  WHEN  WALKING  FROM 
RELATION  TO  RELATION.  THE  LANGUAGE  IS  A RESULT  OF  A TOP-DOWN 
DESIGN  AND  DEVELOPMENT  EFFORT  FOR  A DATABASE  MACHINE  IN 
WHICH  HIGH  LEVEL  LANGUAGE  CONSTRUCTS  ARE  DIRECTLY  SUPPORTED 
BY  THE  HARDWARE.  THIS  PAPER  (l)  GIVES  JUSTIFICATIONS  FOR  THE 
USE  OF  AN  UNNORMALIZED  RELATIONAL  MODEL  ON  WHICH  THE 
LANGUAGE  IS  BASED,  (2)  PRESENTS  THE  CASDAL  LANGUAGE 
CONSTRUCTS  WITH  EXAMPLES,  AND  (3)  DESCRIBES  CASSM’S 
ARCHITECTURE  AND  FACILITATE  THE  TRANSLATION  PROCESS.  THIS 
PAPER  ALSO  ATTEMPTS  TO  SHOW  HOW  THE  EFFICIENCY  OF  THE 
LANGUAGE  AND  THE  TRANSLATION  TASK  CAN  BE  ACHIEVED  AND 
SIMPLIFIED  IN  A SYSTEM  IN  WHICH  THE  LANGUAGE  IS  THE  RESULT 
OF  A TOP-DOWN  SYSTEM  DESIGN  AND  DEVELOPMENT. 
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APPROACH  TO  THE  DESIGN  AND  DEVELOPMENT  OF  DATABASE 
INTERFACES.  THIS  PAPER  PROVIDES  THE  MOTIVATIONAL  BACKGROUND 
FOR  CONTROLLED  PSYCHOLOGICAL  EXPERIMENTATION  IN  EXPLORING 
THE  PERSON/MACHINE  INTERFACE.  FRAMEWORKS  FOR  THE 
REDUCTIONIST  APPROACH  ARE  GIVEN,  RESEARCH  METHODS  DISCUSSED, 
RESEARCH  ISSUES  PRESENTED,  AND  A SMALL  EXPERIMENT  IS  OFFERED 
AS  AN  EXAMPLE  OF  WHAT  CAN  BE  ACCOMPLISHED.  THIS  EXPERIMENT 
IS  A COMPARISON  OF  NATURAL  AND  ARTIFICIAL  LANGUAGE  QUERY 
FACILITIES.  ALTHOUGH  SUBJECTS  POSED  APPROXIMATELY  EQUAL 
NUMBERS  OF  VALID  QUERIES  WITH  EITHER  FACILITY,  NATURAL 
LANGUAGE  USERS  MADE  SIGNIFICANTLY  MORE  INVALID  QUERIES  WHICH 
COULD  NOT  BE  ANSWERED  FROM  THE  DATABASE  THAT  WAS  DESCRIBED. 
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ABSTRACT: 

GIVEN  A FILE  ON  A SECONDARY  STORE  IN  WHICH  EACH  RECORD  HAS 
SEVERAL  ATTRIBUTES,  IT  IS  USUALLY  ADVANTAGEOUS  TO  BUILD  AN 
INDEX  MECHANISM  TO  DECREASE  THE  COST  OF  CONDUCTING 
TRANSACTIONS  TO  THE  FILE.  THE  PROBLEM  OF  SELECTING 
ATTRIBUTES  OVER  WHICH  TO  INDEX  HAS  BEEN  STUDIED  IN  THE 
CONTEXT  OF  VARIOUS  STORAGE  STRUCTURES  AND  ACCESS 
ASSUMPTIONS.  ONE  ALGORITHM  TO  MAKE  AN  OPTIMUM  INDEX 
SELECTION  REQUIRES  2**K  STEPS  IN  THE  WORST  CASE,  WHERE  K IS 
THE  NUMBER  OF  ATTRIBUTES  IN  THE  FILE.  WE  EXAMINE  THE 
QUESTION  OF  WHETHER  A MORE  EFFICIENT  ALGORITHM  MIGHT  EXIST 
AND  SHOW  THAT  EVEN  UNDER  A SIMPLE  COST  CRITERION  THE  PROBLEM 
IS  COMPUTATIONALLY  DIFFICULT  IN  A PRECISE  SENSE.  OUR  RESULTS 
EXTEND  DIRECTLY  TO  OTHER  RELATED  PROBLEMS  WHERE  THE  COST  OF 
INDEX  DEPENDS  ON  FIXED  VALUES  WHICH  ARE  ASSIGNED  TO  EACH 
ATTRIBUTE.  SOME  PRACTICAL  IMPLICATIONS  ARE  DISCUSSED. 
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ABSTRACT: 

A MODEL  OF  DATABASE  STORAGE  AND  ACCESS  IS  PRESENTED.  THE 
MODEL  REPRESENTS  MANY  EVALUATION  ALGORITHMS  AS  SPECIAL 
CASES,  AND  HELPS  TO  BREAK  A COMPLEX  ALGORITHM  INTO  SIMPLE 
ACCESS  OPERATIONS.  GENERALIZED  ACCESS  COST  EQUATIONS 
ASSOCIATED  WITH  THE  MODEL  ARE  DEVELOPED  AND  ANALYZED. 
OPTIMIZATION  OF  THESE  COST  EQUATIONS  YIELDS  AN  OPTIMAL 
ACCESS  ALGORITHM  WHICH  CAN  BE  SYNTHESIZED  BY  A QUERY  SYSTEM 
WHOSE  DESIGN  IS  BASED  ON  THE  MODULAR  ACCESS  OPERATIONS. 
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FILE  DESIGNS  SUITABLE  FOR  RETRIEVAL  FROM  A FILE  OF  K-FIELD 
RECORDS  WHEN  QUERIES  MAY  BE  PARTIALLY  SPECIFIED  ARE 
EXAMINED.  STORAGE  REDUNDANCY  IS  INTRODUCED  TO  OBTAIN 
IMPROVED  WORST-CASE  AND  AVERAGE-CASE  PERFORMANCES.  THE 
RESULTING  STORAGE  SCHEMES  ARE  APPROPRIATE  FOR  REPLICATED 
DISTRIBUTED  DATABASE  ENVIRONMENTS;  IT  IS  POSSIBLE  TO  IMPROVE 
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THE  OVERALL  AVERAGE  AND  WORST-CASE  BEHAVIOR  FOR  QUERY 
RESPONSE  AS  WELL  AS  PROVIDE  AN  ENVIRONMENT  WITH  VERY  HIGH 
RELIABILITY.  WITHIN  PRACTICAL  SYSTEMS  IT  WILL  BE  POSSIBLE  TO 
IMPROVE  THE  QUERY  RESPONSE  TIME  PERFORMANCE  AS  WELL  AS 
RELIABILITY  OVER  COMPARABLE  SYSTEMS  WITHOUT  REPLICATION. 
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A MODIFIED  VERSION  OF  THE  MULTIPLE  ATTRIBUTE  TREE  (MAT) 
DATABASE  ORGANIZATION,  WHICH  USES  A COMPACT  DIRECTORY,  IS 
DISCUSSED.  AN  EFFICIENT  ALGORITHM  TO  PROCESS  THE  DIRECTORY 
FOR  CARRYING  OUT  THE  NODE  SEARCHES  IS  PRESENTED.  STATISTICAL 
PROCEDURES  ARE  DEVELOPED  TO  ESTIMATE  THE  NUMBER  OF  NODES 
SEARCHED  AND  THE  NUMBER  OF  DATA  BLOCKS  RETRIEVED  FOR  MOST 
GENERAL  AND  COMPLEX  QUERIES.  THE  PERFORMANCE  OF  INVERTED 
FILE  AND  MODIFIED  MAT  ORGANIZATIONS  ARE  COMPARED  USING  SIX 
REAL-LIFE  DATABASES  AND  FOUR  TYPES  OF  QUERY  COMPLEXITIES. 
CAREFUL  TRADEOFFS  ARE  ESTABLISHED  IN  TERMS  OF  STORAGE  AND 
ACCESS  TIMES  FOR  DIRECTORY  AND  DATA,  QUERY  COMPLEXITIES,  AND 
DATABASE  CHARACTERISTICS. 
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TWO  EXPERIMENTS  TESTING  THE  ABILITY  OF  SUBJECTS  TO  WRITE 
QUERIES  IN  TWO  DIFFERENT  QUERY  LANGUAGES  WERE  RUN.  THE  TWO 
LANGUAGES,  AQL  AND  TABLET,  DIFFER  PRIMARILY  IN  THEIR 
PROCEDURALITY;  BOTH  LANGUAGES  USE  THE  RELATIONAL  DATA  MODEL, 
AND  THEIR  HALSTEAD  LEVELS  ARE  SIMILAR.  CONSTRUCTS  IN  THE 
LANGUAGES  WHICH  DO  NOT  AFFECT  THEIR  PROCEDURALITY  ARE 
IDENTICAL.  THE  TWO  LANGUAGES  WERE  LEARNED  BY  THE 
EXPERIMENTAL  SUBJECTS  ALMOST  EXCLUSIVELY  FORM  MANUALS 
PRESENTING  THE  SAME  EXAMPLES  AND  PROBLEMS  ORDERED 
IDENTICALLY  FOR  BOTH  LANGUAGES.  THE  RESULTS  OF  THE 
EXPERIMENTS  SHOW  THAT  SUBJECTS  USING  THE  MORE  PROCEDURAL 
LANGUAGE  WROTE  DIFFICULT  QUERIES  BETTER  THAN  SUBJECTS  USING 
THE  LESS  PROCEDURAL  LANGUAGE.  THE  RESULTS  OF  THE  EXPERIMENTS 
ARE  USED  TO  COMPARE  CORRESPONDING  CONSTRUCTS  IN  THE  TWO 
LANGUAGES  AND  TO  RECOMMEND  IMPROVEMENTS  FOR  THESE 
CONSTRUCTS. 
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ABSTRACT: 

A MODEL  FOR  STUDYING  THE  COMBINED  PROBLEMS  OF  FILE  DESIGN 
AND  FILE  ORGANIZATION  IS  PRESENTED.  NEW  MODELING  TECHNIQUES 
FOR  PREDICTING  THE  PERFORMANCE  EVALUATION  OF  FILES  AND  FOR 
FINDING  OPTIMAL  REORGANIZATION  POINTS  FOR  FILES  ARE 
INTRODUCED.  APPLICATIONS  OF  THE  MODEL  TO  HASH-BASED  AND 
INDEXED-SEQUENTIAL  FILES  REVEAL  IMPORTANT  RELATIONSHIPS 
BETWEEN  INITIAL  LOADING  FACTORS  AND  REORGANIZATION 
FREQUENCY.  A PRACTICAL  FILE  DESIGN  STRATEGY,  BASED  ON  THESE 
RELATIONSHIPS,  IS  PROPOSED. 
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ABSTRACT: 

LINEAR  HASHING  WITH  PARTIAL  EXPANSIONS  IS  A NEW  FILE 
ORGANIZATION  PRIMARILY  INTENDED  FOR  FILES  WHICH  GROW  AND 
SHRINK  DYNAMICALLY.  THIS  PAPER  PRESENTS  A MATHEMATICAL 
ANALYSIS  OF  THE  EXPECTED  PERFORMANCE  OF  THE  NEW  SCHEME.  THE 
FOLLOWING  PERFORMANCE  MEASURES  ARE  CONSIDERED:  LENGTH  OF 
SUCCESSFUL  AND  UNSUCCESSFUL  SEARCHES,  ACCESSES  REQUIRED  TO 
INSERT  OR  DELETE  A RECORD,  AND  THE  SIZE  OF  THE  OVERFLOW 
AREA.  THE  PERFORMANCE  IS  CYCLICAL.  FOR  ALL  PERFORMANCE 
MEASURES,  THE  NECESSARY  FORMULAS  ARE  DERIVED  FOR  COMPUTING 
THE  EXPECTED  PERFORMANCE  AT  ANY  POINT  OF  A CYCLE  AND  THE 
AVERAGE  OVER  A CYCLE.  FURTHERMORE,  THE  EXPECTED  WORST  CASE 
IN  CONNECTION  WITH  SEARCHING  IS  ANALYZED.  THE  OVERALL 
PERFORMANCE  DEPENDS  ON  SEVERAL  FILE  PARAMETERS.  THE 
NUMERICAL  RESULTS  SHOW  THAT  FOR  MANY  REALISTIC  PARAMETER 
COMBINATIONS  THE  PERFORMANCE  IS  EXPECTED  TO  BE  EXTREMELY 
GOOD.  EVEN  THE  LONGEST  SEARCH  IS  EXPECTED  TO  BE  OF  QUITE 
REASONABLE  LENGTH. 
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ABSTRACT: 

AS  DATA  ARE  UPDATED,  THE  INITIAL  PHYSICAL  STRUCTURE  OF  A 
DATABASE  IS  CHANGED  AND  RETRIEVAL  OF  SPECIFIC  PIECES  OF  DATA 
BECOMES  MORE  TIME  CONSUMING.  THIS  PHENOMENON  IS  CALLED 
DATABASE  DEGRADATION.  IN  THIS  PAPER  TWO  MODELS  OF  DATABASE 
DEGRADATION  ARE  DESCRIBED.  EACH  MODEL  REFERS  TO  A DIFFERENT 
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ASPECT  OF  THE  PROBLEM.  IT  IS  ASSUMED  THAT  TRANSACTIONS  ARE 
STATISTICALLY  INDEPENDENT  AND  EITHER  ADD,  DELETE,  OR  UPDATE 
DATA.  THE  FIRST  MODEL  EXAMINES  THE  TIME  DURING  WHICH  A BLOCK 
OF  DATA  IS  FILLING  UP.  THE  SECOND  MODEL  EXAMINES  THE 
OVERFLOWS  FROM  A BLOCK  OF  DATA,  WHICH  ESSENTIALLY  DESCRIBES 
THE  BUILDUP  OF  DISORGANIZATION.  ANALYTICAL  RESULTS  ARE 
OBTAINED  FOR  BOTH  MODELS.  IN  ADDITION,  SEVERAL  NUMERICAL 
EXAMPLES  ARE  PRESENTED  WHICH  SHOW  THAT  THE  MEAN  NUMBER  OF 
OVERFLOWS  GROWS  APPROXIMATELY  LINEARLY  WITH  TIME.  THIS 
APPROXIMATION  IS  USED  TO  DEVISE  A SIMPLE  FORMULA  FOR  THE 
OPTIMAL  TIME  TO  REORGANIZE  A STOCHASTICALLY  GROWING 
DATABASE. 
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ABSTRACT: 

THE  NEED  FOR  ROBUST  RECOVERY  FACILITIES  IN  MODERN  DATABASE 
MAJ^AGEMENT  SYSTEMS  IS  QUITE  WELL  KNOWN.  VARIOUS  AUTHORS  HAVE 
ADDRESSED  RECOVERY  FACILITIES  AND  SPECIFIC  TECHNIQUES,  BUT 
NONE  HAVE  DELVED  INTO  THE  PROBLEM  OF  RECOVERY  IN  DATABASE 
MACHINES.  IN  THIS  PAPER,  THE  TYPES  OF  UNDESIRABLE  EVENTS 
THAT  OCCUR  IN  A DATABASE  ENVIRONMENT  ARE  CLASSIFIED  AND  THE 
NECESSARY  RECOVERY  INFORMATION,  WITH  SUBSEQUENT  ACTIONS  TO 
RECOVER  THE  CORRECT  STATE  OF  THE  DATABASE,  IS  SUMMARIZED.  A 
MODEL  OF  THE  "PROCESSOR-  PER-TRACK”  CLASS  OF  PARALLEL 
ASSOCIATIVE  DATABASE  PROCESSOR  IS  PRESENTED.  THREE  DIFFERENT 
TYPES  OF  RECOVERY  MECHANISMS  THAT  MAY  BE  CONSIDERED  FOR 
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PARALLEL  ASSOCIATIVE  DATABASE  PROCESSORS  ARE  IDENTIFIED.  FOR 
EACH  ARCHITECTURE,  BOTH  THE  WORKLOAD  IMPOSED  BY  THE  RECOVERY 
MECHANISMS  ON  THE  EXECUTION  OF  DATABASE  OPERATIONS  (I.E., 
RETRIEVE,  MODIFY,  DELETE,  AND  INSERT)  AND  THE  WORKLOAD 
INVOLVED  IN  THE  RECOVERY  ACTIONS  (I.E.,  ROLLBACK,  RESTART, 
RESTORE,  AND  RECONSTRUCT)  ARE  ANALYZED.  THE  PERFORMANCE  OF 
THE  THREE  ARCHITECTURES  IS  QUANTITATIVELY  COMPARED.  THIS 
COMPARISON  IS  MADE  IN  TERMS  OF  THE  NUMBER  OF  EXTRA 
REVOLUTIONS  OF  THE  DATABASE  AREA  REQUIRED  TO  PROCESS  A 
TRANSACTION  VERSUS  THE  NUMBER  OF  RECORDS  AFFECTED  BY  A 
TRANSACTION.  A VARIETY  OF  DIFFERENT  DESIGN  PARAMETERS  OF  THE 
DATABASE  PROCESSOR,  OF  THE  DATABASE,  AND  OF  A MIX  OF 
TRANSACTION  TYPES  (MODIFY,  INSERT,  AND  DELETE)  ARE 
CONSIDERED.  A LARGE  NUMBER  OF  COMBINATIONS  IS  SELECTED  AND 
THE  EFFECTS  OF  THE  PARAMETERS  ON  THE  EXTRA  PROCESSING  TIME 
ARE  IDENTIFIED. 
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ABSTRACT: 

THE  AUTOMATIC  CORRECTION  OF  MISSPELLED  INPUTS  IS  DISCUSSED 
FROM  A VIEWPOINT  OF  SIMILAR-STRING  MATCHING.  FIRST  A 
HIERARCHICAL  FILE  ORGANIZATION  BASED  ON  A LINEAR  ORDERING  OF 
RECORDS  IS  PRESENTED  FOR  RETRIEVING  RECORDS  HIGHLY  SIMILAR 
TO  ANY  INPUT  QUERY.  THEN  THE  SPELLING  PROBLEM  IS  ATTACKED  BY 
CONSTRUCTING  A HIERARCHICAL  FILE  FOR  A SET  OF  STRINGS  IN  A 
DIRECTORY  OF  ENGLISH  WORDS.  THE  SPELLING  CORRECTION  STEPS 
PROCEED  AS  FOLLOWS:  (l)  FIND  ONE  OF  THE  BEST-MATCH  STRINGS 
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WHICH  ARE  MOST  SIMILAR  TO  A QUERY,  (2)  EXPAND  THE  SEARCH 
AREA  FOR  OBTAINING  THE  GOOD-MATCH  STRINGS,  AND  (3)  INTERRUPT 
THE  FILE  SEARCH  AS  SOON  AS  THE  REQUIRED  STRING  IS  DISPLAYED. 
COMPUTATIONAL  EXPERIMENTS  VERIFY  THE  PERFORMANCE  OF  THE 
PROPOSED  METHODS  FOR  SIMILAR  STRING  MATCHING  UNDER  THE  UNIX 
TIME-SHARING  SYSTEM. 
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ABSTRACT: 

RESEARCHERS  IN  ARTIFICIAL  INTELLIGENCE  HAVE  RECENTLY  BECOME 
INTERESTED  IN  NATURAL  LANGUAGE  FACT  RETRIEVAL;  CURRENTLY, 
THEIR  RESEARCH  IS  AT  A POINT  WHERE  IT  CAN  BEGIN  CONTRIBUTING 
TO  THE  FIELD  OF  INFORMATION  RETRIEVAL.  IN  THIS  PAPER, 

STRATEGIES  FORA  NATURAL  LANGUAGE  FACT  RETRIEVAL  SYSTEM  ARE 
MAPPED  OUT.  AND  APPROACHES  TO  MANY  OF  THE  ORGANIZATION  AND 
RETRIEVAL  PROBLEMS  ARE  PRESENTED.  THE  CYRUS  SYSTEM,  WHICH 
KEEPS  TRACK  OF  IMPORTANT  PEOPLE  AND  IS  QUERIED  IN  ENGLISH, 

IS  PRESENTED  AND  USED  TO  ILLUSTRATE  THOSE  SOLUTIONS. 
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ABSTRACT: 

WE  CONSIDER  THE  PROBLEM  OF  DESIGNING  AN  INFORMATION 
RETRIEVAL  SYSTEM  ON  WHICH  PARTIAL  MATCH  QUERIES  HAVE  TO  BE 
ANSWERED.  EACH  RECORD  IN  THE  SYSTEM  CONSISTS  OF  A LIST  OF 
ATTRIBUTES,  AND  A PARTIAL  MATCH  QUERY  SPECIFIES  THE  VALUES 
OF  SOME  OF  THE  ATTRIBUTES.  THE  RECORDS  ARE  STORED  IN  BUCKETS 
IN  A SECONDARY  MEMORY,  AND  IN  ORDER  TO  ANSWER  A PARTIAL 
MATCH  QUERY  ALL  THE  BUCKETS  THAT  MAY  CONTAIN  A RECORD 
SATISFYING  THE  SPECIFICATIONS  OF  THE  QUERY  MUST  BE 
RETRIEVED.  THE  BUCKET  IN  WHICH  A GIVEN  RECORD  IS  STORED  IS 
FOUND  BY  MULTIPLE  KEY  HASHING  FUNCTION,  WHICH  MAPS  EACH 
ATTRIBUTE  TO  A STRING  OF  A FIXED  NUMBER  OF  BITS.  THE  ADDRESS 
OF  THAT  BUCKET  IS  THEN  REPRESENTED  BY  THE  STRING  OBTAINED  BY 
CONCATENATING  THE  STRINGS  ON  WHICH  THE  VARIOUS  ATTRIBUTES 
WERE  MAPPED.  A PARTIAL  MATCH  QUERY  MAY  SPECIFY  ONLY  PART  OF 
THE  BITS  IN  THE  STRING  REPRESENTING  THE  ADDRESS,  AND  THE 
LARGER  THE  THE  NUMBER  OF  BITS  SPECIFIED,  THE  SMALLER  THE 
NUMBER  OF  BUCKETS  THAT  HAVE  TO  BE  RETRIEVED  IN  ORDER  TO 
ANSWER  THE  QUERY.  THE  OPTIMIZATION  PROBLEM  CONSIDERED  IN 
THIS  PAPER  IS  THAT  OF  DECIDING  TO  HOW  MANY  BITS  EACH 
ATTRIBUTE  SHOULD  BE  MAPPED  BY  THE  HASHING  FUNCTION  ABOVE,  SO 
THAT  THE  EXPECTED  NUMBER  OF  BUCKETS  RETRIEVED  PER  QUERY  IS 
MINIMIZED.  EFFICIENT  SOLUTIONS  FOR  SPECIAL  CASES  OF  THIS 
PROBLEM  HAVE  BEEN  OBTAINED  IN  [l],  [12],  AND  [14].  IT  IS 
SHOWN  THAT  IN  GENERAL  THE  PROBLEM  IS  NP-HARD,  AND  THAT  IF  P 
<>  NP,  IT  IS  ALSO  NOT  FULLY  APPROXIMABLE.  TWO  HEURISTIC 
ALGORITHMS  FOR  THE  PROBLEM  ARE  ALSO  GIVEN  AND  COMPARED. 
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AFFILIATION: 

UNIVERSITY  OF  MELBOURNE 
ABSTRACT: 

THIS  PAPER  STUDIES  A PARTIAL-MATCH  RETRIEVAL  SCHEME  BASED  ON 
HASH  FUNCTIONS  AND  DESCRIPTORS.  THE  EMPHASIS  IS  PLACED  ON 
SHOWING  HOW  THE  USE  OF  A DESCRIPTOR  FILE  CAN  IMPROVE  THE 
PERFORMANCE  OF  THE  SCHEME.  RECORDS  IN  THE  FILE  ARE  GIVEN 
ADDRESSES  ACCORDING  TO  HASH  FUNCTIONS  FOR  EACH  FIELD  IN  THE 
RECORD.  FURTHERMORE,  EACH  PAGE  OF  THE  FILE  HAS  ASSOCIATED 
WITH  IT  A DESCRIPTOR,  WHICH  IS  A FIXED-LENGTH  BIT  STRING, 
DETERMINED  BY  THE  RECORDS  ACTUALLY  PRESENT  IN  THE  PAGE. 

BEFORE  A PAGE  IS  ACCESSED  TO  SEE  IF  IT  CONTAINS  RECORDS  IN 
THE  ANSWER  TO  A QUERY,  THE  DESCRIPTOR  FOR  THE  PAGE  IS 
CHECKED.  THIS  CHECK  MAY  SHOW  THAT  NO  RELEVANT  RECORDS  ARE  ON 
THE  PAGE  AND,  HENCE,  THAT  THE  PAGE  DOES  NOT  HAVE  TO  BE 
ACCESSED.  THE  METHOD  IS  SHOWN  TO  HAVE  A VERY  SUBSTANTIAL 
PERFORMANCE  ADVANTAGE  OVER  PURE  HASHING  SCHEMES,  WHEN  SOME 
FIELDS  IN  THE  RECORDS  HAVE  LARGE  KEY  SPACES.  A MATHEMATICAL 
MODEL  OF  THE  SCHEME,  PLUS  AN  ALGORITHM  FOR  OPTIMIZING 
PERFORMANCE,  IS  GIVEN. 
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DESIGN  » PERFORMANCE  * PARTIAL-MATCH  RETRIEVAL  * HASHING  * 
DESCRIPTOR  * DYNAMIC  FILE  • OPTIMIZATION 
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ABSTRACT: 

IN  MOST  DATABASE  ORGANIZATIONS,  THE  COST  OF  ACCESSING  THE 
DATABASE  WILL  INCREASE  DUE  TO  STRUCTURAL  CHANGES  CAUSED  BY 
UPDATES  AND  INSERTIONS.  BY  REORGANIZING  THE  DATABASE,  THE 
ACCESS  COSTS  CAN  BE  REDUCED.  A BASIC  PROBLEM  IS  TO  ESTABLISH 
THE  PROPER  TRADEOFF  BETWEEN  PERFORMANCE,  STORAGE  COSTS,  AND 
REORGANIZATION  COSTS.  THIS  PAPER  CONSIDERS  THE  OPTIMUM 
POINTS  AT  WHICH  TO  REORGANIZE  A DATABASE.  A DISK  FILE 
ORGANIZATION  WHICH  ALLOWS  FOR  DISTRIBUTED  FREE  SPACE  IS 
DESCRIBED.  A COST  FUNCTION  DESCRIBING  THE  EXCESS  COSTS  DUE 
TO  PHYSICAL  DISORGANIZATION  IS  DEFINED,  AND  THIS  FUNCTION  IS 
MINIMIZED  TO  OBTAIN  THE  OPTIMUM  REORGANIZATION  POINTS. 
NUMERICAL  EXAMPLES  BASED  ON  THE  CHARACTERISTICS  OF  EXISTING 
DISK  STORAGE  DEVICES  ARE  GIVEN. 
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DETERIORATION  » REORGANIZATION 
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AUTHOR(s): 
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* MITOMA,  M.  F.  ♦ RODRIGUEZ-ROSELL,  J. 

AFFILIATION: 

IBM  SAN  JOSE  RESEARCH  LABORATORY 
ABSTRACT: 

THE  VIRTUAL  MACHINE  EMULATOR  IS  AN  ENHANCED  VERSION  OF  IBM’S 
VM/370  PROGRAM  THAT  EXTENDS  THE  VIRTUAL  MACHINE  ENVIRONMENT 
TO  INCLUDE  TIMING  SIMULATION  IN  ADDITION  TO  THE  EXISTING 
SIMULATION  OF  MACHINE  FUNCTION.  BY  SELECTING  PROCESSOR  AND 
I/O  DEVICE  TIMING  CHARACTERISTICS,  THE  USER  CAN  EVALUATE  THE 
PERFORMANCE  OF  A WIDE  RANGE  OF  370  COMPATIBLE  SYSTEMS  WITH 
GREATER  FLEXIBILITY  AND  LOWER  COST  THAN  HARDWARE 
PROTOTYPING.  VALIDATION  DATA  ARE  PRESENTED  SHOWING  THAT  THE 
EMULATOR  IS  AN  ACCURATE  PERFORMANCE  PREDICTOR  WITH  A LOW 
SIMULATION  OVERHEAD. 
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ABSTRACT: 

AMONG  THE  MOST  IMPORTANT  CRITERIA  IN  THE  DESIGN  AND 
IMPLEMENTATION  OF  AN  INTERACTIVE  SYSTEM  FOR  DATA  ANALYSIS 
ARE:  DATA  STRUCTURE,  CONTROL  LANGUAGE,  USER  INTERFACE, 
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SYSTEM  VERSATILITY,  EXTENSIBILITY,  AND  PORTABILITY.  THE 
DESIGN  OF  AN  INTERACTIVE  SYSTEM,  VIEWED  AS  A SET  OF 
CONSTRAINED  DECISIONS  BASED  ON  THESE  CRITERIA,  WILL  BE 
DISCUSSED.  THE  CONCEPTS  AND  CONSIDERATIONS  DISCUSSED  IN  THIS 
ARTICLE  ABOUT  THE  DESIGN  OF  INTERACTIVE  SYSTEMS  ARE  GENERAL 
IN  NATURE  AND  ARE  NEITHER  PROBLEM-SPECIFIC  NOR 
DISCIPLINE-SPECIFIC.  SPECIFIC  EXAMPLES  FROM  STATISTICAL 
PACKAGES  AND  THEIR  DESIGNS  ARE  CITED  FOR  ILLUSTRATION 
PURPOSES  ONLY. 

KEYWORDS: 

DESIGN  OF  INTERACTIVE  SYSTEMS  * SOFTWARE  DESIGN  CRITERIA  * 
USER  INTERFACE 
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STUDYING  PROGRAMMER  BEHAVIOR  EXPERIMENTALLY:  THE  PROBLEMS  OF 
PROPER  METHODOLOGY 

AUTHOR(s): 

BROOKS,  RUVEN  E. 

AFFILIATION: 

THE  UNIVERSITY  OF  TEXAS  MEDICAL  BRANCH,  GALVESTON,  TEXAS 
ABSTRACT: 

THE  APPLICATION  OF  BEHAVIORAL  OR  PSYCHOLOGICAL  TECHNIQUES  TO 
THE  EVALUATION  OF  PROGRAMMING  LANGUAGES  AND  TECHNIQUES  IS  AN 
APPROACH  WHICH  HAS  FOUND  INCREASED  APPLICABILITY  OVER  THE 
PAST  DECADE.  IN  ORDER  TO  USE  THIS  APPROACH  SUCCESSFULLY, 
INVESTIGATORS  MUST  PAY  CLOSE  ATTENTION  TO  METHODOLOGICAL 
ISSUES,  BOTH  IN  ORDER  TO  INSURE  THE  GENERALIZABILITY  OF 
THEIR  FINDINGS  AND  TO  DEFEND  THE  QUALITY  OF  THEIR  WORK  TO 
RESEARCHERS  IN  OTHER  FIELDS.  THREE  MAJOR  AREAS  OF 
METHODOLOGICAL  CONCERN,  THE  SELECTION  OF  SUBJECTS, 

MATERIALS,  AND  MEASURES,  ARE  REVIEWED.  THE  FIRST  TWO  OF 
THESE  AREAS  CONTINUE  TO  PRESENT  MAJOR  DIFFICULTIES  FOR  THIS 
TYPE  OF  RESEARCH. 
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THE  KEYSTROKE-LEVEL  MODEL  FOR  USER  PERFORMANCE  TIME  WITH 
INTERACTIVE  SYSTEMS 
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CARD,  STUART  K.  * MORAN,  THOMAS  P. 

AFFILIATION: 

XEROX  PALO  ALTO  RESEARCH  CENTER  * CARNEGIE-MELLON  UNIVERSITY 
ABSTRACT: 

THERE  ARE  SEVERAL  ASPECTS  OF  USER-COMPUTER  PERFORMANCE  THAT 
SYSTEM  DESIGNERS  SHOULD  SYSTEMATICALLY  CONSIDER.  THIS 
ARTICLE  PROPOSES  A SIMPLE  MODEL,  THE  KEYSTROKE-LEVEL  MODEL, 

FOR  PREDICTING  ONE  ASPECT  OF  PERFORMANCE:  THE  TIME  IT  TAKES 
AN  EXPERT  USER  TO  PERFORM  A GIVEN  TASK  ON  A GIVEN  COMPUTER 
SYSTEM.  THE  MODEL  IS  BASED  ON  COUNTING  KEYSTROKES  AND  OTHER 
LOW-LEVEL  OPERATIONS,  INCLUDING  THE  USER’S  MENTAL 
PREPARATIONS  AND  THE  SYSTEM’S  RESPONSE.  PERFORMANCE  IS  CODED 
IN  TERMS  OF  THESE  OPERATIONS  AND  OPERATOR  TIMES  SUMMED  TO 
GIVE  PREDICTIONS.  HEURISTIC  RULES  ARE  GIVEN  FOR  PREDICTING 
WHERE  MENTAL  PREPARATIONS  OCCUR.  WHEN  TESTED  AGAINST  DATA  IN 
10  DIFFERENT  SYSTEMS,  THE  MODEL’S  PREDICTION  ERROR  IS  21 
PERCENT  FOR  INDIVIDUAL  TASKS-  AN  EXAMPLE  IS  GIVEN  TO 
ILLUSTRATE  HOW  THE  MODEL  CAN  BE  USED  TO  PRODUCE  PARAMETRIC 
PREDICTIONS  AND  HOW  SENSITIVITY  ANALYSIS  CAN  BE  USED  TO 
REDEEM  CONCLUSIONS  IN  THE  FACE  OF  UNCERTAIN  ASSUMPTIONS. 
FINALLY,  THE  MODEL  IS  COMPARED  TO  SEVERAL  SIMPLER  VERSIONS. 

THE  POTENTIAL  ROLE  FOR  THE  KEYSTROKE-LEVEL  MODEL  IN  SYSTEM 
DESIGN  IS  DISCUSSED. 
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ABSTRACT: 

THE  CONCEPT  OF  A HIERARCHY  OF  PERFORMANCE  MODELS  IS 
INTRODUCED.  IT  IS  ARGUED  THAT  SUCH  A HIERARCHY  SHOULD 
CONSIST  OF  MODELS  SPANNING  A WIDE  RANGE  OF  ACCURACY  AND  COST 
IN  ORDER  TO  BE  A COST-EFFECTIVE  TOOL  IN  THE  DESIGN  OF 
COMPUTER  SYSTEMS.  JUDICIOUS  USE  OF  THE  HIERARCHY  CAN  SATISFY 
THE  CONFLICTING  NEEDS  OF  HIGH  ACCURACY  AND  LOW  COST  OF 
PERFORMANCE  EVALUATION.  A SYSTEM  DESIGN  PROCEDURE  THAT  USES 
THE  HIERARCHY  IS  DEVELOPED.  THE  CONCEPTS  DEVELOPED  ARE 
ILLUSTRATED  BY  APPLYING  THEM  TO  A CASE  STUDY  OF  SYSTEM 
DESIGN.  THE  RESULTS  OF  OPTIMIZATIONS  CONDUCTED  USING  A 
TWO-LEVEL  PERFORMANCE  MODEL  HIERARCHY  AND  A SIMPLE  COST 
MODEL  ARE  DISCUSSED.  IN  ALMOST  ALL  THE  EXPERIMENTS 
CONDUCTED,  THE  OPTIMIZATION  PROCEDURE  CONVERGED  TO  A REGION 
VERY  CLOSE  TO  A LOCALLY  OPTIMUM  SYSTEM.  THE  EFFICIENCY  OF 
THE  PROCEDURE  IS  SHOWN  TO  BE  CONSIDERABLY  GREATER  THAN  THAT 
OF  THE  BRUTE  FORCE  APPROACH  TO  SYSTEM  DESIGN. 
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ABSTRACT: 

THE  SWETS  MODEL  OF  INFORMATION  RETRIEVAL,  BASED  ON  A 
DECISION  THEORY  APPROACH,  IS  DISCUSSED,  WITH  THE  OVERALL 
PERFORMANCE  MEASURE  BEING  THE  CRUCIAL  ELEMENT  REEXAMINED  IN 
THIS  PAPER.  THE  NEYMAN-PEARSON  CRITERION  FROM  STATISTICAL 
DECISION  THEORY,  AND  BASED  ON  LIKELIHOOD  RATIOS,  IS  USED  TO 
DETERMINE  AN  OPTIMAL  RANGE  OF  Z,  THE  VARIABLE  ASSIGNED  TO 
EACH  DOCUMENT  BY  THE  RETRIEVAL  SYSTEM  IN  AN  ATTEMPT  TO 
DISCRIMINATE  BETWEEN  RELEVANT  AND  NONRELEV  ANT  DOCUMENTS. 
THIS  CRITERION  IS  SHOWN  TO  BE  DIRECTLY  RELATED  TO  BOTH 
PRECISION  AND  RECALL,  AND  IS  EQUIVALENT  TO  THE  MAXIMIZATION 
OF  THE  EXPECTED  VALUE  OF  THE  RETRIEVAL  DECISION  FOR  A 
SPECIFIC  QUERY  AND  A GIVEN  DOCUMENT  UNDER  CERTAIN 
CONDITIONS.  THUS,  A COMPROMISE  CAN  BE  REACHED  BETWEEN  THOSE 
WHO  .\DVOCATE  PRECISION  AS  A MEASURE,  DUE  PARTIALLY  TO  ITS 
ABILITY  TO  BE  EASILY  MEASURABLE  EMPIRICALLY,  AND  THOSE  WHO 
ADVOCATE  CONSIDERATION  OF  RECALL,  SEVERAL  CASES  OF  THE 
NORMAL  AND  POISSON  DISTRIBUTIONS  FOR  THE  VARIABLE  Z ARE 
DISCUSSED  IN  TERMS  OF  THEIR  IMPLICATIONS  FOR  THE 
NEYMAN-PEARSON  DECISION  RULE.  IT  IS  SEEN  THAT  WHEN  THE 
VARIANCES  ARE  UNEQUAL,  THE  SWETS  RULE  OF  RETRIEVING  A 
DOCUMENT  IF  ITS  Z VALUE  IS  LARGE  ENOUGH  IS  NOT  OPTIMAL. 
FINALLY,  THE  SITUATION  OF  PRECISION  AND  RECALL  NOT  BEING 
INVERSELY  RELATED  IS  SHOWN  TO  BE  POSSIBLE  UNDER  CERTAIN 
CONDITIONS.  THUS,  THIS  PAPER  ATTEMPTS  TO  EXTEND  THE 
UNDERSTANDING  OF  THE  THEORETICAL  FOUNDATIONS  OF  THE  DECISION 
THEORY  APPROACH  TO  INFORMATION  RETRIEVAL. 
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ABSTRACT: 

THE  USE  OF  MULTIPLE-CRITERIA  THEORY,  A MEANS  OF  MEASURING 
DEGREE  OF  SATISFACTION  OF  PREDETERMINED  EVALUATIVE  CRITERIA, 
QUANTIFYING  THEIR  RELATIVE  IMPORTANCE,  IDENTIFYING  TRADEOFFS 
AMONG  THEM,  AND  DETERMINING  THE  BEST  TRADEOFFS,  IS  PROPOSED 
FOR  THE  EVALUATION  OF  INFORMATION  SYSTEMS.  USE  OF  THE 
PROPOSED  METHOD  IS  DEMONSTRATED  VIA  THE  EVALUATION  OF  A 
HYPOTHETICAL  SELECTIVE  DISSEMINATION  OF  INFORMATION  (SDI) 
SYSTEM.  THE  ILLUSTRATIVE  EVALUATION  INVOLVES  (l)  SELECTION 
OF  TWO  SETS  OF  TYPICALLY  ANTITHETIC  CRITERIA:  EFFICIENCY 
(THE  INNER  WORKINGS  OF  THE  SYSTEM)  AND  EFFECTIVENESS  (ITS 
IMPACT  ON  ITS  USERS);  (2)  RANKING  AND  SCORING  EACH  CRITERION 
IN  THE  TWO  SETS;  (3)  SELECTION  OF  ALTERNATIVE  CONFIGURATIONS 
OF  THE  SYSTEM  UNDER  STUDY;  (4)  SCORING  THE  SPECIMEN  AND  THE 
ALTERNATIVE  SYSTEMS  IN  TERMS  OF  THE  RATED  EFFICIENCY  AND 
EFFECTIVENESS  CRITERIA;  AND  (5)  IDENTIFYING  THE  SYSTEM  THAT 
SCORES  THE  HIGHEST.  THE  COMPARATIVE  SCORES  FOR  THE  SYSTEMS 
ARE  DETERMINED  BY  Ui  = [(W’)(SiO  + (W”)(Si”)],  WHERE  Si’ 

AND  Si”  DENOTE  THE  EFFICIENCY  AND  EFFECTIVENESS  SCORES  OF 
THE  iTH  ALTERNATIVE,  AND  W’  AND  W”  ARE  WEIGHTING  CONSTANTS 
THAT  REFLECT  THE  COMPUTED  RELATIVE  IMPORTANCE  OF  EFFICIENCY 
AND  EFFECTIVENESS. 
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ABSTRACT: 

IT  IS  SHOWN  THAT  DIFFERENT  SETS  OF  VARIABLES  CAN  ACCOUNT  FOR 
NEARLY  EQUAL  AMOUNTS  OF  VARIANCE  WHEN  PREDICTING  BOOK 
CIRCULATION  BY  SUBJECT.  PROPORTION  of  VARIANCE  (R**2)  FOR 
TWO  BASIC  MODELS  CONTAINING  VARIOUS  COMBINATIONS  OF  21 
VARIABLES  WERE  TESTED.  THE  FIRST,  CALLED  THE  SHELFLIST 
MODEL,  TREATED  THE  NUMBER  OF  LIBRARY  BOOKS,  WHOSE  SUBJECTS 
MATCH  THOSE  OF  ACADEMIC  DEPARTMENTS,  AS  A CONTROL  VARIABLE. 
AS  SUCH,  IT  ACCOUNTED  FOR  67%  OF  THE  VARIANCE,  THUS  ENTERING 
THE  EQUATION  FIRST.  WITH  THIS  MODEL,  FOUR  SEPARATE 
SIGNIFICANT  SETS  EMERGED,  EACH  ACCOUNTING  FOR  APPROXIMATELY 
THE  SAME  AMOUNT  OF  VARIANCE  (10%).  THEY  WERE  (l)  NUMBER  OF 
FACULTY,  HARD/SOFT,  MASTERS  ENROLLMENTS;  (2)  MASTERS 
ENROLLMENT,  UPPER-LEVEL  MAJORS,  HARD/SOFT;  (3)  CREDIT  HOURS 
* TOTAL  ENROLLMENTS,  HARD/SOFT;  (4)  UPPER-LEVEL  MAJORS, 

TOTAL  MAJORS,  ENROLLMENTS  LOWER.  IN  THE  SECOND,  SHELFLIST 
WAS  CONSTRAINED  BY  DEFINING  THE  DEPENDENT  VARIABLE  AS  THE 
PROPORTION  OF  SHELFLIST  CIRCULATED.  WITH  THIS  MODEL,  THREE 
SEPARATE  SIGNIFICANT  SETS  EMERGED.  THESE  WERE  (5)  MASTERS 
ENROLLMENTS  AND  HARD/SOFT  (209!,)  VARIANCE;  (6)  HARD-SOFT  AND 
PH.  D.  PROGRAM  (16%);  (7)  UPPER-LEVEL  MAJORS,  AND  CREDIT 
HOURS  » TOTAL  MAJORS  (15%).  IN  EACH  OF  THE  TESTS,  NO  OTHER 
VARIABLES  WERE  SIGNIFICANT.  OF  THE  21  VARIABLES,  10  DID  NOT 
APPEAR  IN  ANY  OF  THE  7 SETS.  ANY  OF  THE  SEVEN  SETS  COULD  BE 
USED  IN  AN  ALLOCATION  FORMULA.  THE  DECIDING  CRITERION  FOR 
CHOOSING  A SET  MAY  DEPEND  ON  THE  CONVENIENCE  OF  COLLECTING 
DATA  FOR  EACH  OF  THE  VARIABLES  IN  THE  SET. 
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ABSTRACT: 

THERE  IS  A GREAT  NEED  FOR  A SYSTEMATIC  APPROACH  TO  THE 
SPECIFICATION,  DESIGN,  AND  DEVELOPMENT  OF  INFORMATION 
SYSTEMS.  THIS  ARTICLE  DESCRIBES  THE  MOTIVATING  REASONS  FOR 
SUCH  AN  APPROACH  AND  SURVEYS  SOME  OF  THE  TECHNIQUES  THAT 
HAVE  BEEN  DEVELOPED  TO  ASSIST  THE  SOFTWARE  SPECIFICATION  AND 
DESIGN  ACTIVITY.  A METHODOLOGY  IS  SEEN  AS  A COMBINATION  OF 
TOOLS  AND  TECHNIQUES  EMPLOYED  WITHIN  AN  ORGANIZATIONAL  AND 
MANAGERIAL  FRAMEWORK  THAT  CAN  BE  CONSISTENTLY  APPLIED  TO 
SUCCESSIVE  INFORMATION  SYSTEM  DEVELOPMENT  PROJECTS.  THE  WAYS 
THAT  INFORMATION  SYSTEM  DEVELOPMENT  ORGANIZATIONS  CAN  CREATE 
AND  USE  SUCH  METHODOLOGIES  ARE  EMPHASIZED. 
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AUTHOR(s): 

BROOKES,  BERTRAM  C. 

AFFILIATION: 

SCHOOL  OF  LIBRARY  AND  INFORMATION  SCIENCE,  UNIVERSITY  OF 
WESTERN  ONTARIO,  LONDON,  ONTARIO,  CANADA 

ABSTRACT: 

IT  IS  ARGUED  THAT  IN  INFORMATION  SCIENCE  WE  HAVE  TO 
DISTINGUISH  PHYSICAL,  OBJECTIVE,  OR  DOCUMENT  SPACE  FROM 
PERSPECTIVE,  SUBJECTIVE,  OR  INFORMATION  SPACE.  THESE  TWO 
SPACES  ARE  LIKE  MAPS  AND  LANDSCAPES:  EACH  IS  A SYSTEMATIC 
DISTORTION  OF  THE  OTHER.  HOWEVER,  TRANSFORMATIONS  CAN  BE 
EASILY  MADE  ONCE  THE  TWO  SPACES  ARE  DISTINGUISHED.  IF  THE 
TRANSFORMATIONS  ARE  OMITTED  WE  ONLY  GET  UNHELPFUL  PHYSICAL 
SOLUTIONS  TO  INFORMATION  PROBLEMS. 
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INFORMATION  RETRIEVAL  * SYSTEM  DESIGN  * SYSTEM  EVALUATION 

CATEGORIES: 

3.72  * 4.3  * 5.6 


REFERENCE  CODE:  44 

JOURNAL: 

JASIS 

VOLUME:  31 

ISSUE:  5 

DATE:  SEPTEMBER  1980 
PAGES:  347  - 356 

TITLE: 

TOWARD  USABLE  USER  STUDIES 
AUTHOR(s): 

MICK,  COLIN  K.  * LINDSEY,  GEORG  N.  * CALLAHAN,  DANIEL 
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ABSTRACT: 

A MANAGEMENT-ORIENTED  MODEL  FOR  DESCRIBING  AND  STUDYING 
INFORMATION  BEHAVIOR  IS  PROPOSED.  THE  MODEL  FOCUSES  ON 

VARIABLES  WHICH  CAN  BE  MANIPULATED  BY  MANAGERS PRIMARILY 

ENVIRONMENTAL  AND  SITUATIONAL  VARIABLES RATHER  THAN  ON 

VARIABLES  DESCRIBING  INDIVIDUAL  ATTRIBUTES.  SEVERAL 
HYPOTHESES  DERIVED  FROM  THE  MODEL  ARE  TESTED  USING  A 
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DATABASE  DESCRIBING  THE  INFORMATION-RELATED  ATTITUDES  AND 
BEHAVIORS  OF  SOME  560  560  SCIENTISTS  AND  ENGINEERS  WORKING 
IN  A VARIETY  OF  SETTINGS  AND  ROLES.  ALL  BUT  ONE  OF  THE 
HYPOTHESES  WERE  CONFIRMED,  ADDING  SUPPORT  TO  THE  MODEL.  THE 
RESULTS  OF  THESE  TESTS  SUGGEST  THAT  ENVIRONMENTAL  AND 
SITUATIONAL  CONSTRAINTS  PLAY  A MAJOR  PART  IN  DETERMINING 
INFORMATION  BEHAVIOR.  THEY  SUGGEST  THAT  INTERVENTIONS  AIMED 
AT  IMPROVING  INFORMATION  FLOW  WITHIN  ORGANIZATIONS  MUST  BE 
CAREFULLY  TAILORED  TO  THE  SPECIFIC  SITUATION  IF  THEY  ARE  TO 
HAVE  MAXIMUM  IMPACT. 
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FENICHEL,  CAROL  HANSEN 
AFFILIATION: 

COLLEGE  OF  LIBRARY  SCIENCE,  UNIVERSITY  OF  KENTUCKY,  LEXINGTON 
ABSTRACT: 

THE  PRIMARY  GOAL  OF  THIS  RESEARCH  WAS  TO  DISCOVER  THOSE 
BEHAVIORS  ASSOCIATED  WITH  THE  PROCESS  OF  ONLINE 
BIBLIOGRAPHIC  SEARCHING  THAT  ARE  CORRELATED  WITH  SUCCESS.  IN 
THE  ASSUMPTION  THAT  MORE  EXPERIENCED  SEARCHERS  ARE  MORE 
SUCCESSFUL,  THE  RESEARCH  OBJECTIVES  WERE  TO  IDENTIFY  (l)  THE 
DIFFERENCES  AMONG  THE  SEARCHES  OF  USERS  OF  ONLINE  SYSTEMS 
WHO  HAVE  DIFFERENT  AMOUNTS  OF  OVERALL  EXPERIENCE  AND  (2)  THE 
DIFFERENCES  BETWEEN  THE  SEARCHES  OF  PERSONS  WITH  AND  WITHOUT 
EXPERIENCE  ON  THE  DATABASE  BEING  SEARCHED.  FIVE  GROUPS  OF 
SEARCHERS  WITH  VARIED  OVERALL  AND  ERIC  ( EDUCATIONAL 
RESOURCES  INFORMATION  CENTER)  DATABASE  EXPERIENCE  PERFORMED 
PRESELECTED  SEARCHES  ON  THE  DIALOG  SYSTEM  USING  ONTAP,  THE 
1975  SUBSET  OF  THE  ERIC  DATABASE.  ANALYSIS  OF  THE  SEARCH 
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TRANSCRIPTS  SHOWED  THAT  DIFFERENCES  AMONG  THE  GROUPS  WERE 
NOT  LARGE.  COMPARED  TO  THE  EXPERIENCED  SUBJECTS,  BEGINNING 
SEARCHERS  PERFORMED  SURPRISINGLY  WELL.  THE  GROUP  WITH  THE 
GREATEST  OVERALL  EXPERIENCE  AND  THE  GREATEST  ERIC  DATABASE 
EXPERIENCE  ACHIEVED  THE  HIGHEST  RECALL  AND  HAD  THE  HIGHEST 
VALUES  OF  A SET  OF  SEARCH  PROCESS  VARIABLES  DESIGNATED 
’’SEARCH  EFFORT”  VARIABLES  (EG.,  NUMBER  OF  COMMANDS  AND 
DESCRIPTORS,  CONNECT  TIME)  SUGGESTING  A POSSIBLE 
RELATIONSHIP  BETWEEN  SEARCH  EFFORT  AND  RECALL. 
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INFORMATION  RETRIEVAL  * USER’S  BEHAVIOR  » DATABASE  » 
PERFORMANCE  EVALUATION 
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DEPARTMENT  OF  COMPUTING  AND  INFORMATION  SCIENCE,  QUEEN’S 
UNIVERSITY,  KINGSTON,  ONTARIO,  CANADA 

ABSTRACT: 

THE  RELATIONAL  MODEL  HAS  RECEIVED  INCREASING  ATTENTION 
DURING  THE  PAST  DECADE.  ITS  ADVANTAGES  INCLUDE  SIMPLICITY, 
CONSISTENCY,  AND  A SOUND  THEORETICAL  BASIS.  IN  THIS  ARTICLE. 

THE  NATURALNESS  OF  VIEWING  INFORMATION  RETRIEVAL 
RELATIONALLY  IS  DEMONSTRATED.  THE  RELATIONAL  MODEL  IS 
PRESENTED,  AND  THE  RELATIONAL  ORGANIZATION  OF  A 
BIBLIOGRAPHICAL  DATABASE  IS  SHOWN.  THE  NOTION  OF 
NORMALIZATION  IS  INTRODUCED  AND  FIRST,  SECOND,  THIRD,  AND 
FOURTH  NORMAL  FORMS  ARE  DEMONSTRATED.  RELATIONAL  LANGUAGES 
ARE  DISCUSSED,  INCLUDING  THE  RELATIONAL  CALCULUS,  RELATIONAL 
ALGEBRA,  AND  SEQUEL.  NUMEROUS  EXAMPLES  PERTINENT  TO 
INFORMATION  RETRIEVAL  ARE  PRESENTED  IN  THESE  RELATIONAL 
LANGUAGES.  ADVANTAGES  OF  THE  RELATIONAL  APPROACH  TO 
INFORMATION  RETRIEVAL  ARE  NOTED. 
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CHAPMAN,  JANET  L. 

AFFILIATION: 

SCHOOL  OF  LIBRARY  AND  INFORMATION  SCIENCE,  DREXEL 
UNIVERSITY,  PHILADELPHIA 

ABSTRACT: 

STATISTICAL  ANALYSES  OF  ONLINE  SEARCHING  PATTERNS  COMPARED 
THE  USAGE  OF  A QUERY  LANGUAGE  BY  VARIOUS  GROUPS  OF 
SEARCHERS.  DATA  WERE  GATHERED  BY  AN  EXPERIMENTAL  PROJECT, 
INDIVIDUALIZED  INSTRUCTION  FOR  DATA  ACCESS  (IIDA),  CONCERNED 
WITH  DEVELOPING  AND  TESTING  A SYSTEM  WHICH  SERVES  AS  A 
TEACHER  AND  ASSISTANT  TO  USERS  OF  LOCKHEED’S  DIALOG  SYSTEM. 
SEQUENTIAL  LISTINGS  OF  USER  COMMANDS  WERE  CLASSIFIED  BY 
CORRESPONDING  STATE  CODES  TO  REPRESENT  PHASES  OF  SEARCHING. 
ZERO-THROUGH  FOURTH-ORDER  MARKOVIAN  ANALYSES  OF  INDIVIDUAL 
COMMANDS  AND  STRINGS  OF  LIKE  COMMANDS  WERE  PERFORMED  TO 
COMPARE  SEARCHING  PROCEDURES  USED  BY  THREE  CLASSES  OF  USERS. 
CLASS  1 COMPARED  NOVICES  DIFFERING  IN  THEIR  USE  OF  IIDA  AS 
AN  ADJUNCT  TRAINER;  CLASS  2 COMPARED  INEXPERIENCED, 
IIDA-TRAINED  SEARCHERS  WITH  PROFESSIONAL  SEARCHERS;  CLASS  3 
COMPARED  INEXPERIENCED  SEARCHERS  TAUGHT  BY  EITHER  IIDA  OR 
PROFESSIONAL  SEARCHERS.  ANALYSIS  REVEALED  THAT  SEARCHERS 
TEND  TO  FOLLOW  THE  ADVICE  OF  THEIR  TRAINER,  WHETHER  IT  BE 
HUMAN  OR  COMPUTER.  THE  USE  OF  IIDA  AS  THE  SOLE  TRAINING 
METHOD  APPEARS  TO  PRODUCE  SEARCHERS  WHO  USE  SIMILAR  PATTERNS 
OF  SEARCHING.  THE  USE  OF  ANOTHER  TRAINING  METHOD  IN  ADDITION 
TO  OR  INSTEAD  OF  IIDA  APPEARS  TO  PRODUCE  SEARCHERS  WITH 
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VARIED  AND  INDIVIDUAL  "STYLES”  OF  ONLINE  SEARCHING. 
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A COMPUTER  INTERMEDIARY  FOR  INTERACTIVE  DATABASE  SEARCHING. 

I.  DESIGN 
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MEADOW,  CHARLES  T.  * HEWETT,  THOMAS  T.  » AVERSA,  ELIZABETH  S. 
AFFILIATION: 

DREXEL  UNIVERSITY,  PHILADELPHIA 
ABSTRACT: 

THIS  IS  THE  FIRST  OF  TWO  ARTICLES  THAT  REPORT  ON  THE 
DEVELOPMENT,  TESTING,  AND  EVALUATION  OF  THE  INDIVIDUALIZED 
INSTRUCTION  FOR  DATA  ACCESS  SYSTEM  (IIDA).  IIDA  IS  AN 
EXAMPLE  OF  A CLASS  OF  COMPUTER  SYSTEMS  WHICH  SERVE  AS 
INTERMEDIARIES,  ENABLING  THEIR  USERS  TO  PERFORM  A COMPLEX 
TASK  ON  ANOTHER  COMPUTER,  AND  WHICH  ARE  COMING  TO  BE  KNOWN 
AS  EXPERT  SYSTEMS.  THE  SYSTEM  WAS  DESIGNED  TO  ENCOURAGE  END 
USERS  OF  INFORMATION  RETRIEVAL  SYSTEMS  TO  PERFORM  THEIR  OWN 
SEARCHES  BY  (1)  INSTRUCTING  THEM  IN  HOW  TO  SEARCH,  USING 
COMPUTER-ASSISTED  INSTRUCTION,  AND  (2)  ASSISTING  WITH  THE 
PERFORMANCE  OF  THE  SEARCH  BY  PROVIDING  DIAGNOSTIC  ANALYSES 
OF  THE  USER’S  PERFORMANCE  AS  WELL  AS  ANSWERING  THEIR 
QUESTIONS  ABOUT  HOW  TO  USE  SYSTEM  COMMANDS.  THE  SYSTEM’S 
DESIGN  IS  DESCRIBED,  AS  WELL  AS  THE  VARIOUS  TESTS  OF  ITS 
PERFORMANCE  AND  THE  EVALUATION  OF  TEST  RESULTS.  THE 
CONCLUSION  IS  DRAWN  THAT  END  USERS  CAN  BECOME  SUCCESSFUL 
SEARCHERS  THROUGH  SUCH  AN  ASSISTANT,  FOR  THE  KINDS  OF 
SEARCHES  TESTED. 
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INFORMATION  RETRIEVAL  * DATABASE  * SEARCHING  * SYSTEM  DESIGN 


- 42  - 


* DATA  ACCESS  * SYSTEM  EVALUATION  * PERFORMANCE 


CATEGORIES; 

2.19  * 3.72  * 3.74  * 4.3  * 5.6 

REFERENCE  CODE:  49 

JOURNAL: 

JASIS 

VOLUME:  33 

ISSUE:  6 

DATE:  NOVEMBER  1982 
PAGES:  357  - 364 

TITLE: 

A COMPUTER  INTERMEDIARY  FOR  INTERACTIVE  DATABASE  SEARCHING. 

II.  EVALUATION 

AUTHOR(s): 

MEADOW,  CHARLES  T.  * HEWETT,  THOMAS  T.  * AVERSA,  ELIZABETH  S. 
AFFILIATION: 
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ABSTRACT: 

THIS  IS  THE  SECOND  OF  TWO  ARTICLES  DESCRIBING  THE 
DEVELOPMENT,  TESTING,  AND  EVALUATION  OF  THE  INDIVIDUALIZED 
INSTRUCTION  FOR  DATA  BASE  ACCESS  SYSTEM  (IIDA).  THE  SYSTEM 
WAS  TESTED  IN  AN  INDUSTRIAL  SETTING  AND  IT  WAS  DEMONSTRATED 
THAT  (1)  END  USERS  OF  SCIENTIFIC  AND  TECHNICAL  LITERATURE 
COULD  LEARN  TO  DO  THEIR  OWN  BIBLIOGRAPHIC  SEARCHES  THROUGH 
COMPUTER-ASSISTED  INSTRUCTION  AS  WELL  AS  THEY  LEARNED 
THROUGH  A COMPARABLE  PERIOD  OF  CONVENTIONAL  INSTRUCTION,  AND 
(2)  END  USERS  WERE  AS  SATISFIED  WITH  THE  RESULTS  OF  THEIR 
OWN  SEARCHINGS  AS  WITH  THE  RESULT  OF  SEARCHES  PERFORMED  FOR 
THEM,  FOR  THE  TYPES  OF  SEARCHES  TESTED. 
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INFORMATION  RETRIEVAL  * DATABASES  * SEARCHING  • SYSTEM 
EVALUATION  * PERFORMANCE 
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AFFILIATION: 

DEPARTMENT  OF  ECONOMICS,  PRINCETON  UNIVERSITY,  PRINCETON 
ABSTRACT: 

THE  FOCUS  OF  INFORMATION  RESEARCH  IN  ANY  GIVEN  DISCIPLINE 
DEPENDS  ON  THE  MEANING  OF  THE  WORD  "INFORMATION”  FOR 
SCIENTISTS  IN  THAT  DISCIPLINE.  THIS  ARTICLE  LISTS  SOME  OF 
THE  "DISCIPLINES  OF  INFORMATION”,  INCLUDING  SEVERAL  WITH  A 
STRONG  SYSTEMS  ORIENTATION,  AND  IDENTIFIES  THOSE  INFORMATION 
SCIENTISTS  FOR  WHOM  A KNOWLEDGE  OF  SYSTEMS  METHODOLOGY  IS 
IMPORTANT.  THIS  IS  FOLLOWED  BY  A BROADBRUSH  TREATMENT  OF  THE 
MODERN  SYSTEMS  MOVEMENT:  ITS  ROLE  IN  THE  CHANGING  WORLDVIEW 
OF  SCIENCE,  SOME  DISCIPLINES  (EG.,  CYBERNETICS  AND 
OPERATIONS  RESEARCH)  THAT  HAVE  CONTRIBUTED  TO  ITS 
DEVELOPMENT,  AND  THE  DISTINCTION  THAT  CAN  BE  DRAWN  BETWEEN 
GENERAL  SYSTEMS  THEORY  (GST)  AND  OTHER  APPROACHES  TO  THE 

STUDY  OF  SYSTEMS A THEME  DEVELOPED  BY  MATTESSICH  IN  THE 

ARTICLE  THAT  FOLLOWS. 
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CALIFORNIA,  BERKELEY 

ABSTRACT: 

SEVERAL  OF  THE  DRAWBACKS  OF  CONVENTIONAL  INFORMATION 
RETRIEVAL  SYSTEMS  CAN  BE  OVERCOME  BY  A DESIGN  APPROACH  IN 
WHICH  QUERIES  CONSIST  OF  SETS  OF  TERMS,  EITHER  UNWEIGHTED  OR 
WEIGHTED  WITH  SUBJECTIVE  TERM  PRECISION  ESTIMATES,  AND 
RETRIEVAL  OUTPUTS  ARE  RANKED  BY  PROBABILITY  OF  USEFULNESS 
ESTIMATED  IN  ACCORDANCE  WITH  THE  SO-CALLED  ’’MAXIMUM  ENTROPY 
PRINCIPLE”.  A SYSTEM  ORGANIZED  ALONG  THESE  LINES  COMBINES 
THE  CONVENIENCE  OF  A SIMPLE  INPUT  LANGUAGE  WITH  A POWERFUL 
PROBABILISTIC  INFERENCE  MECHANISM  CAPABLE  OF  EXPLOITING 
KINDS  OF  STATISTICAL  CLUES  NOT  ORDINARILY  USED  IN  SYSTEMS  OF 
TRADITIONAL  DESIGN.  THE  SENSITIVITY  OF  THE  MAXIMUM  ENTROPY 
PRINCIPLE  TO  THE  FREQUENCIES  AND  JOINT  FREQUENCIES  WITH 
WHICH  TERMS  HAVE  BEEN  ASSIGNED  TO  DOCUMENTS  IN  THE 
COLLECTION  RESULTS  IN  A SYSTEM  DESIGN  OF  INCREASED  POWER  AND 
EXPRESSIVENESS  WITHOUT  A CONCOMITANT  INCREASE  IN  THE 
COMPLEXITY  OF  THE  REQUEST  LANGUAGE.  IT  INCORPORATES  THE  MORE 
IMPORTANT  SEARCH  CAPABILITIES  OF  BOTH  BOOLEAN  AND 
CONVENTIONAL  WEIGHTED-REQUEST  LANGUAGES  AND  FACILITATES  THE 
USE  OF  UNCONVENTIONAL  SEARCH  CLUES. 
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THIS  ARTICLE  DISCUSSES  WAYS  TO  IMPROVE  THE  QUALITY  OF 
RETRIEVAL  SYSTEMS  THAT  DEPEND  ON  THE  USE  OF  TRUNCATED  WORDS 
OR  QUASI-WORD  STEMS  AS  AN  INDEXING  VOCABULARY.  THE  PROBLEMS 
ADDRESSED  ARE  THE  GENERALIZABILITY  AND  STABILITY  OF 
DISCRIMINATE  FUNCTION  ANALYSIS  FOR  SELECTING  GOOD  TOPICAL 
TERMS  FROM  ABSTRACTS  OF  HARRIS  SURVEY  PRESS  RELEASES. 

RESULTS  CONFIRM  THAT  TOPICAL  TERMS  CAN  BE  IDENTIFIED  BY 
THEIR  STATISTICAL  PROPERTIES.  CONSISTENTLY  HIGH  RECALL  OF 
TOPICAL  TERMS  UNDER  A VARIETY  OF  DIFFERENT  CONDITIONS 
IMPLIES  PERSISTENT  UNDERLYING  PROPERTIES  STRONG  ENOUGH  TO 
RESIST  CHANGES  IN  TEST  ENVIRONMENT. 
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STATE  UNIVERSITY  * TEXAS,  WOMAN’S  UNIVERSITY,  DENTON 

ABSTRACT: 

THE  RELATIVE  EFFECTIVENESS  OF  INDEXING  USING  FULL-TEXT  OR 
LESS  THAN  FULL-TEXT  WAS  TESTED  USING  A NON-BOOLEAN,  CHAINING 
TYPE  OF  FILE  STRUCTURE  AND  SEARCHING  METHOD.  INDEXING  WAS 
DONE  USING  TITLES,  ABSTRACTS,  FULL-TEXT,  REFERENCES,  AND 
VARIOUS  COMBINATIONS  OF  THESE  SURROGATES  AND  THEN  GOFFMAN’S 
INDIRECT  METHOD  OF  INFORMATION  RETRIEVAL  WAS  USED  TO 
STRUCTURE  AND  SEARCH  THE  FILE.  THE  DATABASE  CONSISTED  OF  733 
DOCUMENTS  AND  38  QUERIES  WERE  SEARCHED.  THE  HYPOTHESIS  OF 
THE  STUDY  AS  A FILE  STRUCTURING  AND  SEARCHING  TECHNIQUE, 
FULL-TEXT  INDEXING  IS  NOT  ESSENTIAL  TO  OPTIMUM  INFORMATION 
RETRIEVAL  EFFECTIVENESS.  THE  OUTCOME  OF  THE  STUDY  WAS 
POSITIVE. 
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ATTACHMENT  6.10 


USL/DBMS  NASA/RECON 
MULTICS  WORKBENCH  SPECIFICATIONS 


I N A S A I 


I NASA  I 


USL/DBMS  NASA/RE(X)N 
MULTICS  WORKBENCH  SPECIFICATIONS 
08/02/84 
Philip  Hall 


There  are  presently  seven  major  components  of  the  workbench 
which  are  available  from  the  main  menu.  These  provide  utilities 
for  management  of  NASA  Project  storage  space  on  MULTICS, 
electronic  mail  management  for  communications  among  project 
participants,  utilities  for  storage  and  .printing  of  mailing 
labels  for  external  ma ilings,  utilities  for  controlling  access  to 
NASA  procedures  and  documents  stored  on  MULTICS,  procedures  for 
storage  and  updating  of  NASA/RECON  project  control  documents  and 
a maintenance  system  for  control  of  books  kept  in  the  IvtASA/RECON 
library. 

Version  2 of  the  MULTICS  workbench  was  completed  on  July 
31,  1984.  New  functions  added  during  the  Sumner  of  1984  were 
access  control,  execution  of  MJLTICS  conxnands  from  within  the 
workbench,  finding  and  listing  of  updated  segments,  and 
manipulation  of  information  related  to  NASA/PC  equipment 
purchases.  Integrity  control  for  all  system  dociunents  was  also 
incorporated  into  the  system  as  was  integrity  control  relating  to 
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recovery  from  system  errors. 

The  seven  major  branches  from  the  root  of  the  system  are 
listed  below  and  the  functions  which  they  perform  are  sumnarized. 
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I.  SEGJvlENTS  PRCXTESSING. 

A.  Allow  user  to  specify  different  Laser  printer  font 
selections  for  the  La  ser  printing  of  document  s . 

B.  Add  standard  formats  in  he ade r s / f oo t e r s , such  as  date, 
title,  or  other  user-specified  info  rma  t i o n . 

C.  Provides  integration  of  related  segments  into  archives 
and  generation  of  integrated  runout  document  s f r om 
related  runoff  segments.  Standard  names  must  be 
followed  by  all  programs  and  users  to  ensure 
c ompa t ab i lity.  Archive  configurations  should  also  be 
similar,  i.e.,  <subject>.<te  rm>  .archive . 

D.  Provides  a listing  of  all  available  segments  in  given 
directories  and/or  archives. 


II.  TAPE  BACKUP  PROCESSOR. 

A.  Provides  tape  contents  for  standard  tapes  used  in  the 
'DBMS  l^SA/RECON  project  as  well  as  user-defined  tapes. 

B.  Provides  storage  and  retrieval  absentee  requests  for 
all  authorized  tape  users. 


III.  MULTICS  MAILING  LIST  FORMATTER. 

A.  Provides  for  mailing  list  generation. 

B.  Provides  for  upda  t es  to  existing  ma  iling  lists. 

C.  Provides  capability  of  creating  a segment  and  sending 
the  contents  of  the  segment  to  members  of  a mailing 
list. 

D.  Allows  users  to  display  contents  of  a mailing  list. 

E.  Allows  users  to  display  names  of  all  available  mailing 
lists. 

F.  Saves  all  ma  i 1 i n a 1 ogma  i 1 box  and  all  ows  users  to  read 
ma  i 1 in  tha  t ma  i 1 box . 
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IV.  MAILING  LABELS  LIST  PROCESSOR. 

A.  Provides  capabilities  of  creating  lists  of  sendees  for 
all  NASA  related  mai louts. 

B.  Provides  for  printing  of  existing  mailing  labels  lists. 

C.  Provides  mailing  label  list  add/de  1 e t e /upda t e / 1 i s t 
facility. 

D.  Provides  for  the  printing  of  mailing  labels  through  the 
MULTICS  label  printing  facilities. 


V . AEMI N I STRAT I VE  FUNCT I ONS 


A.  Access  Control 

1.  List  all  se gme nts  accessible  to  a user. 

2.  List  all  users  with  access  to  a directory. 

3.  List  all  users  with  access  to  a segment. 

4.  Set  access  for  combinations  of  segment  lists  or 
single  segments  to  user  lists  or  single  users. 

5.  Create  and  update  lists  of  users  to  be  given 
i dent ical  access. 

6.  Create  and  update  lists  of  segments  and  directories 
which  are  to  be  treated  as  a unit  in  setting  access 
r ight  s . 

B.  Check  for  segments  which  have  been  updated  subsequent  to 

a user-supplied  date  in  a si ng le  directory  or  a root 
directory  and  its  sub-tree. 
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VI.  STATUS  DOCUMENT  PROCESSOR. 

A.  Process  out  lay/ status  document 
(NASA/PC  Capital  Expenditures). 

1.  Add  new  entries  to  the  document. 

2.  Process  any  required  updates  to  the  document. 

3.  Print  single  or  multiple  copies  of  the  document  on 
either  the  I/O  room  printer  or  the  CMPS  printer. 

B.  Print  single  copies  of  out  1 ay/ s tatus  document. 

C.  Process  tasks/status  document. 

(Project  task  control  document). 

1.  Add  new  entries  to  the  document. 

2.  Process  any  required  updates  to  the  document. 

3.  Provide  report  generation  based  on: 

i.  Person  responsible  for  a task. 

ii.  Status  of  a given  task. 

iii.  Completion  date  of  a given  task. 

iv.  List  of  tasks  for  a given  person. 

V.  List  of  tasks  to  be  completed  by  a date. 

4.  Print  copies  of  the  task/status  document  on  the  I/O 
room  printer  or  the  CMPS  printer. 

5.  Initialization  of  a new  tasks/status  document. 

D.  Print  single  copies  of  the  tasks/status  document. 


I M U L T I C S I 


5 


IWORKBENCH  I 


I NASA  I 


I N A S A I 


VII.  CHECKOUT  OF  NASA/ RECON  DOCUMENTS  . 

A.  Create  a file  of  doc  ume  n t s . 

B.  Add  documents  to  a file. 

C.  Process  checkout  of  a given  document. 

D.  Process  return  of  a borrowed  document. 

E*  Process  and  send  mail  to  any  individual  with  overdue 
document  s . 

E*  Provide  ability  to  trace  documents  to  the  current  user. 
G.  Print  a doc  ume  n t file. 
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